Nov 02 09:52:17 devstack cinder-volume[75374]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:52:17 devstack cinder-volume[75374]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:52:17 devstack cinder-volume[75374]: we strongly recommend against using it for new projects. Nov 02 09:52:17 devstack cinder-volume[75374]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:52:17 devstack cinder-volume[75374]: framework. For more detail see Nov 02 09:52:17 devstack cinder-volume[75374]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:52:17 devstack cinder-volume[75374]: import eventlet # noqa Nov 02 09:52:21 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:52:21 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:52:21 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:52:22 devstack cinder-volume[75374]: INFO dbcounter [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Registered counter for database cinder Nov 02 09:52:22 devstack cinder-volume[75374]: DEBUG oslo_db.sqlalchemy.engines [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:22 devstack cinder-volume[75374]: DEBUG dbcounter [-] [75374] Writer thread running {{(pid=75374) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:52:22 devstack cinder-volume[75374]: INFO cinder.rpc [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:52:22 devstack cinder-volume[75374]: INFO cinder.rpc [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:52:22 devstack cinder-volume[75374]: DEBUG oslo_db.sqlalchemy.engines [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:22 devstack cinder-volume[75374]: INFO cinder.volume.manager [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Determined volume DB was empty at startup. Nov 02 09:52:22 devstack cinder-volume[75374]: DEBUG cinder.volume.manager [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75374) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:52:22 devstack cinder-volume[75374]: INFO cinder.volume.manager [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 09:52:22 devstack cinder-volume[75374]: WARNING stevedore.named [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:52:22 devstack cinder-volume[75374]: WARNING castellan.key_manager [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:52:22 devstack cinder-volume[75374]: WARNING cinder.keymgr.conf_key_mgr [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:52:22 devstack cinder-volume[75374]: DEBUG cinder.volume.drivers.lvm [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75374) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 09:52:22 devstack cinder-volume[75374]: DEBUG oslo_concurrency.processutils [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75374) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_concurrency.processutils [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] CMD "cinder-rtstool verify" returned: 0 in 0.429s {{(pid=75374) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_db.sqlalchemy.engines [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:23 devstack cinder-volume[75374]: INFO cinder.rpc [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 09:52:23 devstack cinder-volume[75374]: INFO cinder.rpc [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 09:52:23 devstack cinder-volume[75374]: WARNING stevedore.named [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:52:23 devstack cinder-volume[75374]: WARNING castellan.key_manager [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:52:23 devstack cinder-volume[75374]: INFO cinder.volume.manager [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_db.sqlalchemy.engines [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:23 devstack cinder-volume[75374]: INFO oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Starting 1 workers Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Started child 75551 {{(pid=75374) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:52:23 devstack cinder-volume[75551]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Full set of CONF: {{(pid=75374) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] ******************************************************************************** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Configuration options gathered from: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] ================================================================================ {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] allow_availability_zone_fallback = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] allow_compression_on_image_upload = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] allowed_direct_url_schemes = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] api_rate_limit = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] auth_strategy = keystone {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] az_cache_duration = 3600 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_availability_zone = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_host = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_stats_polling_interval = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backup_api_class = cinder.backup.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backup_name_template = backup-%s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backup_use_same_host = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backup_use_temp_snapshot = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] chap_password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] chap_username = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cinder_internal_tenant_project_id = 25a4b16cec8e4231b4aeb3604403be6d {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cinder_internal_tenant_user_id = 320ffc1207604c29a22ec4eb3cd9bba7 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cloned_volume_same_az = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cluster = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] compression_format = gzip {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] compute_api_class = cinder.compute.nova.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] config_dir = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] config_source = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] control_exchange = openstack {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] debug = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] default_availability_zone = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] default_group_type = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] default_volume_type = lvmdriver-1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] disk_geometry = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] driver_client_cert = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] driver_client_cert_key = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] driver_data_namespace = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] driver_ssl_cert_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] driver_ssl_cert_verify = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] driver_use_ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] enable_force_upload = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] enable_new_services = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] enable_unsupported_driver = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] enforce_multipath_for_image_xfer = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] filter_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_api_insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_api_servers = ['http://192.168.122.145/image'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_api_ssl_compression = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_ca_certificates_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_catalog_info = image:glance:publicURL {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_num_retries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance_request_timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] goodness_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] graceful_shutdown_timeout = 5 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] group_api_class = cinder.group.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] host = devstack {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_compress_on_upload = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_conversion_address_space_limit = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_conversion_cpu_limit = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_conversion_disable = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_introspection_address_space_limit = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_introspection_cpu_limit = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_upload_use_cinder_backend = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_upload_use_internal_tenant = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_volume_cache_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_volume_cache_max_count = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] image_volume_cache_max_size_gb = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] init_host_max_objects_retrieval = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] instance_format = [instance: %(uuid)s] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] iscsi_target_flags = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] iscsi_write_cache = on {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] iser_helper = tgtadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] iser_ip_address = 192.168.122.145 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75551]: INFO cinder.volume.manager [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] iser_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] log_color = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] log_config_append = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] log_dir = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] log_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] log_options = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] log_rotate_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] log_rotate_interval_type = days {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] log_rotation_type = none {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] max_age = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] max_logfile_count = 30 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] max_logfile_size_mb = 200 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] max_over_subscription_ratio = 20.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] message_reap_interval = 86400 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] message_ttl = 2592000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] migration_create_volume_timeout_secs = 300 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] monkey_patch = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] monkey_patch_modules = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] my_ip = 192.168.122.145 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] no_snapshot_gb_quota = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] num_iser_scan_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] num_shell_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] num_volume_device_scan_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] nvmeof_conn_info_version = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] nvmet_ns_id = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] nvmet_port_id = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] osapi_max_limit = 1000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] osapi_volume_ext_list = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] osapi_volume_listen_port = 8776 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] osapi_volume_use_ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] osapi_volume_workers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] per_volume_size_limit = -1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] periodic_fuzzy_delay = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] periodic_interval = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] public_endpoint = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] publish_errors = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] quota_backup_gigabytes = 1000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] quota_backups = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] quota_gigabytes = 1000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] quota_groups = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] quota_snapshots = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] quota_volumes = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] rate_limit_burst = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] rate_limit_except_level = CRITICAL {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] rate_limit_interval = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] reinit_driver_count = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] replication_device = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] report_discard_supported = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] report_interval = 120 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] reservation_clean_interval = 86400 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] reservation_expire = 86400 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] reserved_image_namespaces = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] reserved_percentage = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] rpc_response_timeout = 120 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] run_external_periodic_tasks = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] scst_target_driver = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] scst_target_iqn_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_down_time = 720 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] shell_completion = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] snapshot_name_template = snapshot-%s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] snapshot_same_host = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] state_path = /opt/stack/data/cinder {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] storage_availability_zone = nova {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] storage_protocol = iSCSI {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] syslog_log_facility = LOG_USER {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] target_helper = lioadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] target_ip_address = 192.168.122.145 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] target_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] target_protocol = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] target_secondary_ip_addresses = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] trace_flags = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] transport_url = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] until_refresh = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] use_chap_auth = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] use_default_quota_class = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] use_journal = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] use_json = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] use_multipath_for_image_xfer = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] use_stderr = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] use_syslog = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] verify_glance_signatures = enabled {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_api_class = cinder.volume.api.API {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_backend_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_clear = zero {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_clear_ionice = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_clear_size = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_copy_bps_limit = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_dd_blocksize = 1M {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_name_template = volume-%s {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_service_inithost_offload = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volume_usage_audit_period = month {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] zoning_mode = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_concurrency.disable_process_locking = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.auth_section = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.auth_type = password {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.auth_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.cache = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.include_service_catalog = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.interface = public {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcache_username = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.region_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.service_type = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.145/identity {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.backend = dogpile.cache.null {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.backend_argument = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.backend_expiration_time = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.config_prefix = cache.oslo {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.debug_cache_backend = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.enable_retry_client = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.enable_socket_keepalive = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.expiration_time = 600 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.hashclient_retry_attempts = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.memcache_dead_retry = 300 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.memcache_pool_maxsize = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.memcache_sasl_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.proxies = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.redis_db = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.redis_server = localhost:6379 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.retry_attempts = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.retry_delay = 0.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.socket_keepalive_count = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.socket_keepalive_idle = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.socket_keepalive_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.socket_timeout = 1.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.tls_allowed_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.tls_cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack sudo[75634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 09:52:23 devstack sudo[75634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.tls_certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.tls_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.tls_keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cache.username = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] coordination.backend_url = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.asyncio_connection = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.asyncio_slave_connection = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.backend = sqlalchemy {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.connection = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.connection_debug = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.connection_parameters = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.connection_recycle_time = 3600 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.connection_trace = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.db_inc_retry_interval = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.db_max_retries = 20 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.db_max_retry_interval = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.db_retry_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.max_overflow = 50 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.max_pool_size = 5 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.max_retries = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.mysql_wsrep_sync_wait = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.pool_timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.retry_interval = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.slave_connection = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.sqlite_synchronous = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.synchronous_reader = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] database.use_db_reconnect = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_tracing.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.connection_string = messaging:// {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.es_doc_type = notification {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.es_scroll_size = 10000 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.es_scroll_time = 2m {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.filter_error_trace = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.hmac_keys = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.sentinel_service_name = mymaster {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.socket_timeout = 0.1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.trace_requests = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler.trace_sqlalchemy = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler_jaeger.process_tags = {} {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler_jaeger.service_name_prefix = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] profiler_otlp.service_name_prefix = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.enforce_new_defaults = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.policy_default_rule = default {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.policy_file = policy.yaml {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] privsep_osbrick.group = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] privsep_osbrick.helper_command = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] privsep_osbrick.user = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cinder_sys_admin.group = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cinder_sys_admin.helper_command = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] cinder_sys_admin.user = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.auth_section = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.auth_type = password {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.collect_timing = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.send_service_user_token = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.tls_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] service_user.tls_min_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.auth_section = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.auth_type = password {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.collect_timing = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.region_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.tls_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] glance.tls_min_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.backend_availability_zone = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.chap_password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.chap_username = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.disk_geometry = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.driver_client_cert = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.driver_client_cert_key = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.driver_data_namespace = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.driver_use_ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.extra_capabilities = {} {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.filter_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.goodness_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.iscsi_target_flags = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.iscsi_write_cache = on {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.iser_helper = tgtadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.iser_ip_address = 192.168.122.145 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.iser_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.lvm_share_target = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.lvm_type = auto {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.num_shell_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.replication_device = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.report_discard_supported = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.reserved_percentage = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.target_helper = tgtadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.target_ip_address = 192.168.122.145 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.target_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.target_protocol = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.trace_flags = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.unique_fqdn_network = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.use_chap_auth = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volume_backend_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volume_clear = zero {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volume_clear_ionice = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volume_clear_size = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_reports.file_event_handler = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_reports.log_dir = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.backend_host = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.chap_password = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.chap_username = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.disk_geometry = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.driver_client_cert = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.extra_capabilities = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.filter_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.goodness_function = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.iser_helper = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.iser_ip_address = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.iser_port = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.lvm_share_target = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.lvm_type = auto {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.num_shell_tries = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.replication_device = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.report_discard_supported = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.reserved_percentage = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.scst_target_driver = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.storage_protocol = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.target_helper = lioadm {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.target_ip_address = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.target_port = 3260 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.trace_flags = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.use_chap_auth = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volume_clear = zero {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volume_clear_size = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] lvmdriver-1.volumes_dir = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_notifications.driver = [] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_notifications.retry = -1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] key_manager.fixed_key = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.barbican_api_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.barbican_endpoint = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.barbican_endpoint_type = public {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.barbican_region_name = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.collect_timing = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.number_of_retries = 60 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.retry_delay = 1 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.send_service_user_token = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.tls_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.tls_min_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.verify_ssl = True {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican.verify_ssl_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.auth_section = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.auth_type = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.cafile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.certfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:23 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.collect_timing = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.insecure = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.keyfile = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.split_loggers = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.timeout = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.tls_ciphers = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] barbican_service_user.tls_min_version = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.approle_role_id = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.approle_secret_id = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.auth_method = approle {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.auth_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.kv_mountpoint = secret {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.kv_path = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.kv_version = 2 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.namespace = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.root_token_id = **** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.ssl_ca_crt_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.timeout = 60.0 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.token_file = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.token_role = None {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.use_ssl = False {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:52:24 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] ******************************************************************************** {{(pid=75374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:52:24 devstack sudo[75634]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:24 devstack sudo[75739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:24 devstack sudo[75739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:24 devstack sudo[75739]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.273s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:52:24 devstack cinder-volume[75551]: INFO cinder.brick.local_dev.lvm [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:24 devstack sudo[75838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:24 devstack sudo[75838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:24 devstack sudo[75838]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG cinder.brick.local_dev.lvm [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75551) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 09:52:24 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:24 devstack sudo[75941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:24 devstack sudo[75941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:26 devstack sudo[75941]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.689s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:26 devstack sudo[76214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:26 devstack sudo[76214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:26 devstack sudo[76214]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.425s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:26 devstack sudo[76296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 09:52:26 devstack sudo[76296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:27 devstack sudo[76296]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:27 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.289s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:27 devstack sudo[76299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:27 devstack sudo[76299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:27 devstack sudo[76299]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:27 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.352s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:27 devstack sudo[76302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:27 devstack sudo[76302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:27 devstack sudo[76302]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:27 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.386s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:27 devstack sudo[76312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:27 devstack sudo[76312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:28 devstack sudo[76312]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack sudo[76315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:28 devstack sudo[76315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:28 devstack sudo[76315]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack sudo[76319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:28 devstack sudo[76319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:28 devstack sudo[76319]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75551]: INFO cinder.volume.drivers.lvm [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:28 devstack sudo[76324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:28 devstack sudo[76324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:29 devstack sudo[76324]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:29 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.333s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:29 devstack cinder-volume[75551]: DEBUG cinder.volume.drivers.lvm [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Updating volume stats {{(pid=75551) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:52:29 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack sudo[76328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:29 devstack sudo[76328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:29 devstack sudo[76328]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:29 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:29 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack sudo[76332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:29 devstack sudo[76332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:29 devstack sudo[76332]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:29 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:29 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack sudo[76335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:29 devstack sudo[76335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:30 devstack sudo[76335]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:30 devstack sudo[76338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:30 devstack sudo[76338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:30 devstack sudo[76338]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[75551]: INFO cinder.volume.driver [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG cinder.volume.driver [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75551) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG oslo_db.sqlalchemy.engines [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG dbcounter [-] [75551] Writer thread running {{(pid=75551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG cinder.db.api [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Building query based on filter {{(pid=75551) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG cinder.image.image_utils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75551) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:52:30 devstack cinder-volume[75551]: INFO cinder.keymgr.migration [None req-25045356-346d-44ed-b59f-56ca1baadb4a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG cinder.volume.drivers.lvm [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Updating volume stats {{(pid=75551) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:30 devstack sudo[76343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:30 devstack sudo[76343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:30 devstack sudo[76343]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:30 devstack sudo[76346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:30 devstack sudo[76346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:31 devstack sudo[76346]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:31 devstack sudo[76350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:31 devstack sudo[76350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:31 devstack sudo[76350]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:31 devstack sudo[76356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:31 devstack sudo[76356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:31 devstack sudo[76356]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG cinder.manager [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Notifying Schedulers of capabilities ... {{(pid=75551) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:31 devstack cinder-volume[75551]: INFO cinder.volume.manager [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Driver initialization completed successfully. Nov 02 09:52:31 devstack cinder-volume[75551]: INFO cinder.manager [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Initiating service 2 cleanup Nov 02 09:52:31 devstack cinder-volume[75551]: INFO cinder.manager [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Service 2 cleanup completed. Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG cinder.service [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Creating RPC server for service cinder-volume {{(pid=75551) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG cinder.service [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75551) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:52:31 devstack cinder-volume[75551]: INFO cinder.volume.manager [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG cinder.volume.drivers.lvm [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Updating volume stats {{(pid=75551) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:52:31 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:31 devstack sudo[76359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:52:31 devstack sudo[76359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:32 devstack sudo[76359]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:32 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.381s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:32 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:32 devstack sudo[76362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:32 devstack sudo[76362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:32 devstack sudo[76362]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:32 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:32 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:32 devstack sudo[76367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:52:32 devstack sudo[76367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:33 devstack sudo[76367]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:33 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.355s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:33 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:33 devstack sudo[76373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:52:33 devstack sudo[76373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:33 devstack sudo[76373]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:33 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.396s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:33 devstack cinder-volume[75551]: INFO cinder.volume.manager [None req-f4733c3d-c014-4f96-b99d-bcdcb44be87e None None] Driver post RPC initialization completed successfully. Nov 02 09:52:33 devstack cinder-volume[75374]: DEBUG dbcounter [-] [75374] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75374) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:52:43 devstack cinder-volume[75551]: DEBUG dbcounter [-] [75551] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:52:43 devstack cinder-volume[75551]: DEBUG dbcounter [-] [75551] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:53:25 devstack cinder-volume[75551]: DEBUG oslo_service.periodic_task [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75551) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:53:25 devstack cinder-volume[75551]: DEBUG cinder.volume.drivers.lvm [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Updating volume stats {{(pid=75551) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:53:25 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:25 devstack sudo[78227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:53:25 devstack sudo[78227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:25 devstack sudo[78227]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:25 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:25 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:25 devstack sudo[78230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:53:25 devstack sudo[78230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:26 devstack sudo[78230]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:26 devstack sudo[78233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:53:26 devstack sudo[78233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:26 devstack sudo[78233]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:26 devstack sudo[78236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:53:26 devstack sudo[78236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:26 devstack sudo[78236]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:26 devstack cinder-volume[75551]: DEBUG cinder.manager [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Notifying Schedulers of capabilities ... {{(pid=75551) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:53:26 devstack cinder-volume[75551]: DEBUG oslo_service.periodic_task [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running periodic task VolumeManager._thread_info {{(pid=75551) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:53:26 devstack cinder-volume[75551]: DEBUG cinder.volume.manager [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] thread count: 6 {{(pid=75551) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:53:26 devstack cinder-volume[75551]: DEBUG cinder.volume.manager [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] thread info: [<_MainThread(MainThread, started 138797007802496)>, , , , , ] {{(pid=75551) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:54:25 devstack cinder-volume[75551]: DEBUG oslo_service.periodic_task [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75551) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:54:25 devstack cinder-volume[75551]: DEBUG cinder.volume.drivers.lvm [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Updating volume stats {{(pid=75551) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:54:25 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:25 devstack sudo[81492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:54:25 devstack sudo[81492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:25 devstack sudo[81492]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:25 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:25 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:25 devstack sudo[81495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:54:25 devstack sudo[81495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:26 devstack sudo[81495]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:26 devstack sudo[81498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:54:26 devstack sudo[81498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:26 devstack sudo[81498]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:26 devstack sudo[81501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:54:26 devstack sudo[81501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:26 devstack sudo[81501]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:26 devstack cinder-volume[75551]: DEBUG cinder.manager [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Notifying Schedulers of capabilities ... {{(pid=75551) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:54:26 devstack cinder-volume[75551]: DEBUG oslo_service.periodic_task [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running periodic task VolumeManager._thread_info {{(pid=75551) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:54:26 devstack cinder-volume[75551]: DEBUG cinder.volume.manager [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] thread count: 6 {{(pid=75551) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:54:26 devstack cinder-volume[75551]: DEBUG cinder.volume.manager [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] thread info: [<_MainThread(MainThread, started 138797007802496)>, , , , , ] {{(pid=75551) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:54:43 devstack cinder-volume[75551]: DEBUG dbcounter [-] [75551] Writing DB stats cinder:SELECT=1 {{(pid=75551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:54:43 devstack cinder-volume[75551]: DEBUG dbcounter [-] [75551] Writing DB stats cinder:UPDATE=1 {{(pid=75551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:55:25 devstack cinder-volume[75551]: DEBUG oslo_service.periodic_task [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75551) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:55:25 devstack cinder-volume[75551]: DEBUG cinder.volume.drivers.lvm [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Updating volume stats {{(pid=75551) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:55:25 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:25 devstack sudo[83675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:55:25 devstack sudo[83675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:25 devstack sudo[83675]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:25 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:25 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:25 devstack sudo[83692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:25 devstack sudo[83692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:26 devstack sudo[83692]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:26 devstack sudo[83707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:55:26 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:26 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:26 devstack sudo[83711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:55:26 devstack sudo[83711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:26 devstack sudo[83711]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:26 devstack cinder-volume[75551]: DEBUG oslo_concurrency.processutils [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:26 devstack cinder-volume[75551]: DEBUG cinder.manager [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Notifying Schedulers of capabilities ... {{(pid=75551) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:56:25 devstack cinder-volume[75551]: DEBUG oslo_service.periodic_task [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] Running periodic task VolumeManager._thread_info {{(pid=75551) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:56:25 devstack cinder-volume[75551]: DEBUG cinder.volume.manager [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] thread count: 6 {{(pid=75551) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:56:25 devstack cinder-volume[75551]: DEBUG cinder.volume.manager [None req-3024067b-be20-4a5e-a8ac-930f0af40fba None None] thread info: [<_MainThread(MainThread, started 138797007802496)>, , , , , ] {{(pid=75551) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:56:43 devstack cinder-volume[75551]: DEBUG dbcounter [-] [75551] Writing DB stats cinder:SELECT=1 {{(pid=75551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:56:43 devstack cinder-volume[75551]: DEBUG dbcounter [-] [75551] Writing DB stats cinder:UPDATE=1 {{(pid=75551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:17 devstack cinder-volume[75374]: INFO oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Caught SIGTERM, stopping children Nov 02 09:57:17 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Acquiring lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:17 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Acquired lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:17 devstack cinder-volume[75374]: DEBUG oslo_concurrency.lockutils [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Releasing lock "singleton_lock" {{(pid=75374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:17 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Stop services. {{(pid=75374) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 09:57:17 devstack cinder-volume[75374]: DEBUG oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Killing children. {{(pid=75374) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 09:57:17 devstack cinder-volume[75374]: INFO oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Waiting on 1 children to exit Nov 02 09:57:21 devstack cinder-volume[75551]: DEBUG oslo_concurrency.lockutils [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Acquiring lock "singleton_lock" {{(pid=75551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:21 devstack cinder-volume[75551]: DEBUG oslo_concurrency.lockutils [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Acquired lock "singleton_lock" {{(pid=75551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:21 devstack cinder-volume[75551]: DEBUG oslo_concurrency.lockutils [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Releasing lock "singleton_lock" {{(pid=75551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:21 devstack cinder-volume[75551]: WARNING amqp [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:57:21 devstack cinder-volume[75551]: WARNING amqp [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:57:21 devstack cinder-volume[75374]: INFO oslo_service.backend._eventlet.service [None req-11b285f4-4e34-48ab-b119-949297e48792 None None] Child 75551 exited with status 0 Nov 02 09:57:22 devstack cinder-volume[86015]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:57:22 devstack cinder-volume[86015]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:57:22 devstack cinder-volume[86015]: we strongly recommend against using it for new projects. Nov 02 09:57:22 devstack cinder-volume[86015]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:57:22 devstack cinder-volume[86015]: framework. For more detail see Nov 02 09:57:22 devstack cinder-volume[86015]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:57:22 devstack cinder-volume[86015]: import eventlet # noqa Nov 02 09:57:24 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:24 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:24 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:25 devstack cinder-volume[86015]: INFO dbcounter [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Registered counter for database cinder Nov 02 09:57:25 devstack cinder-volume[86015]: DEBUG oslo_db.sqlalchemy.engines [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG dbcounter [-] [86015] Writer thread running {{(pid=86015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:57:26 devstack cinder-volume[86015]: INFO cinder.rpc [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:57:26 devstack cinder-volume[86015]: INFO cinder.rpc [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_db.sqlalchemy.engines [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:26 devstack cinder-volume[86015]: INFO cinder.volume.manager [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Determined volume DB was empty at startup. Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG cinder.volume.manager [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86015) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:57:26 devstack cinder-volume[86015]: INFO cinder.volume.manager [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 09:57:26 devstack cinder-volume[86015]: WARNING stevedore.named [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:57:26 devstack cinder-volume[86015]: WARNING castellan.key_manager [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:57:26 devstack cinder-volume[86015]: WARNING cinder.keymgr.conf_key_mgr [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:57:26 devstack cinder-volume[86015]: INFO cinder.volume.manager [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_db.sqlalchemy.engines [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:26 devstack cinder-volume[86015]: INFO oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Starting 1 workers Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Started child 86233 {{(pid=86015) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Full set of CONF: {{(pid=86015) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] ******************************************************************************** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Configuration options gathered from: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] ================================================================================ {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] allow_availability_zone_fallback = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] allow_compression_on_image_upload = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] allowed_direct_url_schemes = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] api_rate_limit = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] auth_strategy = keystone {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_availability_zone = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_host = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_stats_polling_interval = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backup_api_class = cinder.backup.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backup_name_template = backup-%s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backup_use_same_host = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backup_use_temp_snapshot = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] chap_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] chap_username = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cinder_internal_tenant_project_id = 25a4b16cec8e4231b4aeb3604403be6d {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cinder_internal_tenant_user_id = 320ffc1207604c29a22ec4eb3cd9bba7 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86233]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cluster = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] compression_format = gzip {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] compute_api_class = cinder.compute.nova.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] config_dir = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] config_source = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] control_exchange = openstack {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] debug = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] default_availability_zone = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] default_group_type = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] default_volume_type = QuobyteHD {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] disk_geometry = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] driver_client_cert = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] driver_client_cert_key = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] driver_data_namespace = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] driver_ssl_cert_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] driver_ssl_cert_verify = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] driver_use_ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] enable_new_services = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] enable_unsupported_driver = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] enabled_backends = ['QuobyteHD'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] enforce_multipath_for_image_xfer = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] filter_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_api_insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_api_servers = ['http://192.168.122.145/image'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_api_ssl_compression = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_ca_certificates_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_catalog_info = image:glance:publicURL {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_num_retries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance_request_timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] goodness_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] graceful_shutdown_timeout = 5 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] group_api_class = cinder.group.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] host = devstack {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_compress_on_upload = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_conversion_address_space_limit = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_conversion_cpu_limit = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_conversion_disable = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_introspection_address_space_limit = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_introspection_cpu_limit = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_upload_use_cinder_backend = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_upload_use_internal_tenant = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_volume_cache_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_volume_cache_max_count = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] image_volume_cache_max_size_gb = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] init_host_max_objects_retrieval = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] instance_format = [instance: %(uuid)s] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] iscsi_target_flags = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] iscsi_write_cache = on {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] iser_helper = tgtadm {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] iser_ip_address = 192.168.122.145 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] iser_port = 3260 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] log_color = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] log_config_append = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] log_dir = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] log_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] log_options = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] log_rotate_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] log_rotate_interval_type = days {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] log_rotation_type = none {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] max_age = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] max_logfile_count = 30 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] max_logfile_size_mb = 200 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] max_over_subscription_ratio = 20.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] message_reap_interval = 86400 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] message_ttl = 2592000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] migration_create_volume_timeout_secs = 300 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] monkey_patch = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] monkey_patch_modules = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] my_ip = 192.168.122.145 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] no_snapshot_gb_quota = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] num_iser_scan_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] num_shell_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] num_volume_device_scan_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] nvmeof_conn_info_version = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] nvmet_ns_id = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] nvmet_port_id = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] osapi_max_limit = 1000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] osapi_volume_ext_list = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] osapi_volume_listen_port = 8776 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] osapi_volume_use_ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] osapi_volume_workers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] per_volume_size_limit = -1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] periodic_fuzzy_delay = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] periodic_interval = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] public_endpoint = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] publish_errors = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] quota_backup_gigabytes = 1000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] quota_backups = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] quota_gigabytes = 1000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] quota_groups = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] quota_snapshots = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] quota_volumes = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] rate_limit_burst = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] rate_limit_except_level = CRITICAL {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] rate_limit_interval = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] reinit_driver_count = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] replication_device = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] report_discard_supported = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] report_interval = 120 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] reservation_clean_interval = 86400 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] reservation_expire = 86400 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] reserved_image_namespaces = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] reserved_percentage = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] rpc_response_timeout = 120 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] run_external_periodic_tasks = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] scst_target_driver = iscsi {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] scst_target_iqn_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_down_time = 720 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] shell_completion = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] snapshot_name_template = snapshot-%s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] state_path = /opt/stack/data/cinder {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] storage_availability_zone = nova {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] storage_protocol = iSCSI {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] syslog_log_facility = LOG_USER {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] target_helper = lioadm {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] target_ip_address = 192.168.122.145 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] target_port = 3260 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] target_protocol = iscsi {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] target_secondary_ip_addresses = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] trace_flags = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] transport_url = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] until_refresh = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] use_chap_auth = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] use_default_quota_class = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] use_journal = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] use_json = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] use_multipath_for_image_xfer = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] use_stderr = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] use_syslog = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] verify_glance_signatures = enabled {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_api_class = cinder.volume.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_backend_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_clear = zero {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_clear_ionice = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_clear_size = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_copy_bps_limit = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_dd_blocksize = 1M {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_name_template = volume-%s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_service_inithost_offload = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volume_usage_audit_period = month {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] zoning_mode = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_concurrency.disable_process_locking = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.auth_section = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.auth_type = password {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.auth_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.cache = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.include_service_catalog = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86233]: INFO cinder.volume.manager [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.remotefs [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86233) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.interface = public {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcache_username = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.region_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.service_type = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.145/identity {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.backend = dogpile.cache.null {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.backend_argument = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.backend_expiration_time = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.config_prefix = cache.oslo {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.debug_cache_backend = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.enable_retry_client = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.enable_socket_keepalive = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.expiration_time = 600 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.hashclient_retry_attempts = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.memcache_dead_retry = 300 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.memcache_pool_maxsize = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.memcache_sasl_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.proxies = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.redis_db = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.redis_server = localhost:6379 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.retry_attempts = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.retry_delay = 0.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.socket_keepalive_count = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.socket_keepalive_idle = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.socket_keepalive_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.socket_timeout = 1.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.tls_allowed_ciphers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.tls_cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.tls_certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.tls_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.tls_keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cache.username = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] coordination.backend_url = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.asyncio_connection = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.asyncio_slave_connection = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.backend = sqlalchemy {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.connection = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.connection_debug = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.connection_parameters = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.connection_recycle_time = 3600 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.connection_trace = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.db_inc_retry_interval = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.db_max_retries = 20 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.db_max_retry_interval = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.db_retry_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.max_overflow = 50 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.max_pool_size = 5 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.max_retries = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.mysql_wsrep_sync_wait = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.pool_timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.retry_interval = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.slave_connection = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.sqlite_synchronous = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.synchronous_reader = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] database.use_db_reconnect = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_tracing.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.connection_string = messaging:// {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.es_doc_type = notification {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.es_scroll_size = 10000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.es_scroll_time = 2m {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.filter_error_trace = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.hmac_keys = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.sentinel_service_name = mymaster {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.socket_timeout = 0.1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.trace_requests = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler.trace_sqlalchemy = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler_jaeger.process_tags = {} {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler_jaeger.service_name_prefix = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] profiler_otlp.service_name_prefix = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.enforce_new_defaults = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.policy_default_rule = default {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.policy_file = policy.yaml {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] privsep_osbrick.group = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] privsep_osbrick.helper_command = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] privsep_osbrick.user = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cinder_sys_admin.group = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cinder_sys_admin.helper_command = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] cinder_sys_admin.user = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.auth_section = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.auth_type = password {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.collect_timing = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.send_service_user_token = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.tls_ciphers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] service_user.tls_min_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.auth_section = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.auth_type = password {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.collect_timing = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.region_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.tls_ciphers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] glance.tls_min_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.backend_availability_zone = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.chap_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.chap_username = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.disk_geometry = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.driver_client_cert = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.driver_client_cert_key = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.driver_data_namespace = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.driver_use_ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.extra_capabilities = {} {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.filter_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.goodness_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.iscsi_target_flags = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.iscsi_write_cache = on {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.iser_helper = tgtadm {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.iser_ip_address = 192.168.122.145 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.iser_port = 3260 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86233) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86233]: WARNING cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 09:57:26 devstack cinder-volume[86233]: WARNING cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_host = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_login = admin {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_mount_options = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_private_key = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Running cmd (subprocess): mount.quobyte {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_share_path = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.num_shell_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.quobyte_volume_url = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.replication_device = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.report_discard_supported = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.reserved_percentage = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.target_helper = tgtadm {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.target_ip_address = 192.168.122.145 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.target_port = 3260 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.target_protocol = iscsi {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.trace_flags = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.unique_fqdn_network = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.use_chap_auth = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.volume_backend_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.volume_clear = zero {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.volume_clear_ionice = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.volume_clear_size = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_reports.file_event_handler = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_reports.log_dir = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.backend_availability_zone = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.backend_host = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.chap_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.chap_username = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.chiscsi_conf = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.disk_geometry = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.driver_client_cert = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.driver_data_namespace = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.driver_use_ssl = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.extra_capabilities = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.filter_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.goodness_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.iser_helper = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.iser_ip_address = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.iser_port = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.iser_target_prefix = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_host = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_login = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_mount_options = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_private_key = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_share_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_ssh_port = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.num_shell_tries = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.nvmet_port_id = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.replication_device = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.report_discard_supported = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.reserved_percentage = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.scst_target_driver = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.storage_protocol = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.target_helper = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.target_ip_address = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.target_port = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.target_prefix = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.target_protocol = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.trace_flags = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.use_chap_auth = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.volume_clear = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.volume_clear_size = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] QuobyteHD.volumes_dir = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_notifications.driver = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_notifications.retry = -1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] key_manager.fixed_key = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.barbican_api_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.barbican_endpoint = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.barbican_endpoint_type = public {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.barbican_region_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.collect_timing = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack quobyte-client[86236]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.number_of_retries = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.retry_delay = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.send_service_user_token = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.tls_ciphers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.tls_min_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack quobyte-client[86236]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.verify_ssl = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican.verify_ssl_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.auth_section = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.auth_type = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.collect_timing = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.tls_ciphers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] barbican_service_user.tls_min_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.approle_role_id = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.approle_secret_id = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.auth_method = approle {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.auth_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.kv_mountpoint = secret {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.kv_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.kv_version = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.namespace = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.root_token_id = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.ssl_ca_crt_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.timeout = 60.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.token_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.token_role = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.use_ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:26 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] ******************************************************************************** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:57:26 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:26 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:26 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:26 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:26 devstack cinder-volume[86233]: INFO cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 ... Nov 02 09:57:26 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 -c /etc/quobyte/client-cinder.cfg {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:27 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 -c /etc/quobyte/client-cinder.cfg Nov 02 09:57:27 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:27 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.494s {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:27 devstack cinder-volume[86233]: INFO cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 succeeded Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.510s {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:27 devstack sudo[86340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:57:27 devstack sudo[86340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:27 devstack sudo[86340]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.281s {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:27 devstack cinder-volume[86233]: INFO cinder.volume.driver [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG cinder.volume.driver [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.816318511963, 'free_capacity_gb': 1773.816318511963, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86233) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG oslo_db.sqlalchemy.engines [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86233) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG dbcounter [-] [86233] Writer thread running {{(pid=86233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG cinder.db.api [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Building query based on filter {{(pid=86233) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG cinder.image.image_utils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86233) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:57:27 devstack cinder-volume[86233]: INFO cinder.keymgr.migration [None req-97ce2695-2d5e-451f-b44f-1d2f02298574 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:27 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:27 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:57:27 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:28 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.260s {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG cinder.manager [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Notifying Schedulers of capabilities ... {{(pid=86233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:28 devstack cinder-volume[86233]: INFO cinder.volume.manager [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Driver initialization completed successfully. Nov 02 09:57:28 devstack cinder-volume[86233]: INFO cinder.manager [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Initiating service 3 cleanup Nov 02 09:57:28 devstack cinder-volume[86233]: INFO cinder.manager [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Service 3 cleanup completed. Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG cinder.service [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Creating RPC server for service cinder-volume {{(pid=86233) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG cinder.service [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86233) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:57:28 devstack cinder-volume[86233]: INFO cinder.volume.manager [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.quobyte [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:28 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:57:28 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:28 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:28 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.333s {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:28 devstack cinder-volume[86233]: INFO cinder.volume.manager [None req-74fd403c-0d0f-4061-9ab9-04c27474c916 None None] Driver post RPC initialization completed successfully. Nov 02 09:57:34 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:34 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:34 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.quobyte [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86233) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:34 devstack cinder-volume[86233]: DEBUG cinder.volume.drivers.quobyte [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86233) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:34 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86233) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:34 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:34 devstack cinder-volume[86015]: INFO oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Caught SIGTERM, stopping children Nov 02 09:57:34 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Acquiring lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:34 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Acquired lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:34 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Releasing lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:34 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Stop services. {{(pid=86015) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 09:57:34 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Killing children. {{(pid=86015) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 09:57:34 devstack cinder-volume[86015]: INFO oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Waiting on 1 children to exit Nov 02 09:57:34 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:57:34 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:34 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:34 devstack cinder-volume[86233]: DEBUG oslo_concurrency.processutils [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.326s {{(pid=86233) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:34 devstack cinder-volume[86233]: DEBUG cinder.manager [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Notifying Schedulers of capabilities ... {{(pid=86233) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Unable to connect to AMQP server on 192.168.122.145:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server [None req-3aa710f2-49b2-44a4-a9b6-a6166c6e69f2 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.145:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server method() Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server self._producer.publish( Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server return _publish( Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server listener(*args) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server raise error_for_code( Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server self.transport._send( Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.145:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 02 09:57:34 devstack cinder-volume[86233]: ERROR oslo_messaging.rpc.server Nov 02 09:57:36 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Acquiring lock "singleton_lock" {{(pid=86233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:36 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Acquired lock "singleton_lock" {{(pid=86233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:36 devstack cinder-volume[86233]: DEBUG oslo_concurrency.lockutils [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Releasing lock "singleton_lock" {{(pid=86233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:36 devstack cinder-volume[86233]: WARNING amqp [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:57:36 devstack cinder-volume[86233]: WARNING amqp [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:57:36 devstack cinder-volume[86015]: INFO oslo_service.backend._eventlet.service [None req-1cbcf22e-db02-4000-96bb-d14dccc3d2f0 None None] Child 86233 exited with status 0 Nov 02 09:57:37 devstack cinder-volume[86545]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:57:37 devstack cinder-volume[86545]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:57:37 devstack cinder-volume[86545]: we strongly recommend against using it for new projects. Nov 02 09:57:37 devstack cinder-volume[86545]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:57:37 devstack cinder-volume[86545]: framework. For more detail see Nov 02 09:57:37 devstack cinder-volume[86545]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:57:37 devstack cinder-volume[86545]: import eventlet # noqa Nov 02 09:57:41 devstack cinder-volume[86545]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86545) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:57:41 devstack cinder-volume[86545]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86545) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:57:41 devstack cinder-volume[86545]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86545) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:57:42 devstack cinder-volume[86545]: INFO dbcounter [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Registered counter for database cinder Nov 02 09:57:42 devstack cinder-volume[86545]: DEBUG oslo_db.sqlalchemy.engines [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:42 devstack cinder-volume[86545]: DEBUG dbcounter [-] [86545] Writer thread running {{(pid=86545) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:57:42 devstack cinder-volume[86545]: INFO cinder.rpc [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:57:42 devstack cinder-volume[86545]: INFO cinder.rpc [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:57:42 devstack cinder-volume[86545]: DEBUG oslo_db.sqlalchemy.engines [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:42 devstack cinder-volume[86545]: INFO cinder.volume.manager [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Determined volume DB was empty at startup. Nov 02 09:57:42 devstack cinder-volume[86545]: DEBUG cinder.volume.manager [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86545) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:57:42 devstack cinder-volume[86545]: WARNING stevedore.named [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:57:42 devstack cinder-volume[86545]: WARNING castellan.key_manager [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:57:42 devstack cinder-volume[86545]: WARNING cinder.keymgr.conf_key_mgr [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:57:42 devstack cinder-volume[86545]: INFO cinder.volume.manager [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_db.sqlalchemy.engines [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:43 devstack cinder-volume[86545]: INFO oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Starting 1 workers Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Started child 86840 {{(pid=86545) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Full set of CONF: {{(pid=86545) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] ******************************************************************************** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] Configuration options gathered from: {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] ================================================================================ {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] allow_availability_zone_fallback = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86840]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] allow_compression_on_image_upload = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] allowed_direct_url_schemes = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] api_rate_limit = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] auth_strategy = keystone {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_availability_zone = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_host = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_stats_polling_interval = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backup_api_class = cinder.backup.api.API {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backup_name_template = backup-%s {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backup_use_same_host = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backup_use_temp_snapshot = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] chap_password = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] chap_username = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cinder_internal_tenant_project_id = 25a4b16cec8e4231b4aeb3604403be6d {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cinder_internal_tenant_user_id = 320ffc1207604c29a22ec4eb3cd9bba7 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cluster = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] compression_format = gzip {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] config_dir = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] config_source = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] control_exchange = openstack {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] debug = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] default_availability_zone = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] default_group_type = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] default_volume_type = QuobyteHD {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] disk_geometry = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] driver_client_cert = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] driver_client_cert_key = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] driver_data_namespace = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] driver_ssl_cert_path = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] driver_ssl_cert_verify = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] driver_use_ssl = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] enable_new_services = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] enable_unsupported_driver = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] enforce_multipath_for_image_xfer = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] filter_function = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_api_insecure = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_api_servers = ['http://192.168.122.145/image'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_api_ssl_compression = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_ca_certificates_file = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_certfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_keyfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_num_retries = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance_request_timeout = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] goodness_function = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] graceful_shutdown_timeout = 5 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] group_api_class = cinder.group.api.API {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] host = devstack {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_compress_on_upload = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_conversion_address_space_limit = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_conversion_cpu_limit = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_conversion_disable = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_introspection_address_space_limit = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_introspection_cpu_limit = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_upload_use_cinder_backend = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_upload_use_internal_tenant = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_volume_cache_enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86840) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_volume_cache_max_count = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] init_host_max_objects_retrieval = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] instance_format = [instance: %(uuid)s] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] iscsi_target_flags = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] iscsi_write_cache = on {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] iser_helper = tgtadm {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] iser_ip_address = 192.168.122.145 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] iser_port = 3260 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] log_color = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] log_config_append = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] log_dir = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] log_file = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] log_options = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] log_rotate_interval = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] log_rotate_interval_type = days {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] log_rotation_type = none {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] max_age = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] max_logfile_count = 30 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] max_logfile_size_mb = 200 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] max_over_subscription_ratio = 20.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] message_reap_interval = 86400 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] message_ttl = 2592000 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] monkey_patch = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] monkey_patch_modules = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] my_ip = 192.168.122.145 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] no_snapshot_gb_quota = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] num_iser_scan_tries = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] num_shell_tries = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] num_volume_device_scan_tries = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] nvmeof_conn_info_version = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] nvmet_ns_id = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] nvmet_port_id = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] osapi_max_limit = 1000 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] osapi_volume_ext_list = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] osapi_volume_listen_port = 8776 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] osapi_volume_use_ssl = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] osapi_volume_workers = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] per_volume_size_limit = -1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] periodic_fuzzy_delay = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] periodic_interval = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] public_endpoint = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] publish_errors = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] quota_backup_gigabytes = 1000 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] quota_backups = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] quota_gigabytes = 1000 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] quota_groups = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] quota_snapshots = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] quota_volumes = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] rate_limit_burst = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] rate_limit_except_level = CRITICAL {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] rate_limit_interval = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] reinit_driver_count = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] replication_device = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] report_discard_supported = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] report_interval = 120 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] reservation_clean_interval = 86400 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] reservation_expire = 86400 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] reserved_image_namespaces = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] reserved_percentage = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] rpc_response_timeout = 120 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] run_external_periodic_tasks = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] scst_target_driver = iscsi {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] scst_target_iqn_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_down_time = 720 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] shell_completion = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] snapshot_name_template = snapshot-%s {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] split_loggers = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] state_path = /opt/stack/data/cinder {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] storage_availability_zone = nova {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] storage_protocol = iSCSI {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] syslog_log_facility = LOG_USER {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] target_helper = lioadm {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] target_ip_address = 192.168.122.145 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] target_port = 3260 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] target_protocol = iscsi {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] target_secondary_ip_addresses = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] trace_flags = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] transport_url = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] until_refresh = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] use_chap_auth = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] use_default_quota_class = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] use_journal = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] use_json = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] use_multipath_for_image_xfer = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] use_stderr = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] use_syslog = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] verify_glance_signatures = enabled {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_api_class = cinder.volume.api.API {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_backend_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_clear = zero {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_clear_ionice = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_clear_size = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_copy_bps_limit = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_dd_blocksize = 1M {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_name_template = volume-%s {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_service_inithost_offload = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volume_usage_audit_period = month {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] zoning_mode = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.auth_section = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.auth_type = password {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.auth_version = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.cache = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.certfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.insecure = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.interface = public {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.keyfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_password = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcache_username = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.region_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.service_type = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.145/identity {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.backend = dogpile.cache.null {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.backend_argument = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.backend_expiration_time = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.config_prefix = cache.oslo {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.debug_cache_backend = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.enable_retry_client = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.enable_socket_keepalive = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.expiration_time = 600 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.memcache_dead_retry = 300 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.memcache_sasl_enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.password = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.proxies = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.redis_db = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.redis_server = localhost:6379 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.retry_attempts = 2 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.retry_delay = 0.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.socket_keepalive_count = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.socket_keepalive_idle = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.socket_keepalive_interval = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.socket_timeout = 1.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.tls_allowed_ciphers = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.tls_cafile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.tls_certfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.tls_enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.tls_keyfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cache.username = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] coordination.backend_url = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.asyncio_connection = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.asyncio_slave_connection = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.backend = sqlalchemy {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.connection = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.connection_debug = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.connection_parameters = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.connection_recycle_time = 3600 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.connection_trace = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.db_inc_retry_interval = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.db_max_retries = 20 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.db_max_retry_interval = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.db_retry_interval = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.max_overflow = 50 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.max_pool_size = 5 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.max_retries = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86840) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.pool_timeout = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.quobyte [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 09:57:43 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.quobyte [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.retry_interval = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.slave_connection = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.sqlite_synchronous = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.synchronous_reader = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] database.use_db_reconnect = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Running cmd (subprocess): mount.quobyte {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_tracing.insecure = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.connection_string = messaging:// {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.es_doc_type = notification {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.es_scroll_size = 10000 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.es_scroll_time = 2m {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.filter_error_trace = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.hmac_keys = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.sentinel_service_name = mymaster {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.socket_timeout = 0.1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.trace_requests = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler.trace_sqlalchemy = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler_jaeger.process_tags = {} {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] profiler_otlp.service_name_prefix = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.policy_default_rule = default {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] privsep_osbrick.group = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] privsep_osbrick.helper_command = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] privsep_osbrick.user = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cinder_sys_admin.group = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cinder_sys_admin.helper_command = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] cinder_sys_admin.user = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.auth_section = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.auth_type = password {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.cafile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.certfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.collect_timing = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.insecure = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.keyfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.send_service_user_token = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.split_loggers = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.timeout = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.tls_ciphers = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] service_user.tls_min_version = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.auth_section = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.auth_type = password {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.certfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.collect_timing = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.insecure = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.keyfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.region_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.split_loggers = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.timeout = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.tls_ciphers = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] glance.tls_min_version = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.backend_availability_zone = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.chap_password = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.chap_username = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.disk_geometry = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.driver_client_cert = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.driver_data_namespace = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.driver_use_ssl = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.extra_capabilities = {} {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.filter_function = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack quobyte-client[86841]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.goodness_function = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack quobyte-client[86841]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.iscsi_target_flags = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.iser_ip_address = 192.168.122.145 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.iser_port = 3260 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_host = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_login = admin {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_mount_options = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_password = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_private_key = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_share_path = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.replication_device = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.report_discard_supported = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.target_helper = tgtadm {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.target_ip_address = 192.168.122.145 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.target_port = 3260 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.target_protocol = iscsi {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.trace_flags = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.use_chap_auth = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.volume_backend_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.volume_clear = zero {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_reports.file_event_handler = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_reports.log_dir = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.backend_host = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.chap_password = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.chap_username = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.disk_geometry = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.driver_client_cert = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.extra_capabilities = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.filter_function = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.goodness_function = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.iser_helper = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.iser_ip_address = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.iser_port = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_host = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_login = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_mount_options = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_password = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_private_key = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_share_path = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.num_shell_tries = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.replication_device = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.report_discard_supported = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.reserved_percentage = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.scst_target_driver = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.storage_protocol = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.target_helper = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.target_ip_address = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.target_port = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.target_prefix = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.target_protocol = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.trace_flags = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.use_chap_auth = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.volume_clear = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.volume_clear_size = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] QuobyteHD.volumes_dir = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_notifications.driver = [] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] key_manager.fixed_key = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.barbican_api_version = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.barbican_endpoint = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.barbican_endpoint_type = public {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.barbican_region_name = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.cafile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.certfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.collect_timing = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.insecure = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.keyfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.number_of_retries = 60 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.retry_delay = 1 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.send_service_user_token = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.split_loggers = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.timeout = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.tls_ciphers = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.tls_min_version = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.verify_ssl = True {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican.verify_ssl_path = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.auth_section = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.auth_type = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.cafile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.certfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.collect_timing = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.insecure = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.keyfile = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.split_loggers = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.timeout = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.tls_ciphers = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] barbican_service_user.tls_min_version = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.approle_role_id = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.approle_secret_id = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.auth_method = approle {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.auth_path = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.kv_mountpoint = secret {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.kv_path = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.kv_version = 2 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.namespace = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.root_token_id = **** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.ssl_ca_crt_file = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.timeout = 60.0 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.token_file = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.token_role = None {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.use_ssl = False {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:57:43 devstack cinder-volume[86545]: DEBUG oslo_service.backend._eventlet.service [None req-d48a9954-8920-4349-b4fe-95520db51ed5 None None] ******************************************************************************** {{(pid=86545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:57:43 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.320s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:43 devstack cinder-volume[86840]: INFO cinder.volume.driver [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG cinder.volume.driver [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8139152526855, 'free_capacity_gb': 1773.8139152526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86840) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_db.sqlalchemy.engines [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86840) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writer thread running {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG cinder.db.api [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Building query based on filter {{(pid=86840) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86840) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:44 devstack cinder-volume[86840]: INFO cinder.keymgr.migration [None req-7fbe3f9a-95dc-4603-aa0e-b5fa86bb88f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:57:44 devstack sudo[86853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:57:44 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:44 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.274s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Driver initialization completed successfully. Nov 02 09:57:44 devstack cinder-volume[86840]: INFO cinder.manager [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Initiating service 3 cleanup Nov 02 09:57:44 devstack cinder-volume[86840]: INFO cinder.manager [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Service 3 cleanup completed. Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG cinder.service [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Creating RPC server for service cinder-volume {{(pid=86840) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG cinder.service [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86840) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:57:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:44 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:57:44 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:44 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.278s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-616bd5fe-0984-497e-bcc0-6d48251bfb37 None None] Driver post RPC initialization completed successfully. Nov 02 09:57:53 devstack cinder-volume[86545]: DEBUG dbcounter [-] [86545] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86545) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:54 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=1 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:54 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:58:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:58:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 6 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:58:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Flow 'volume_create_manager' (fabb801a-463b-4948-9217-0d21f1972c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4deeea-cfde-425b-9544-abe1fc551f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4deeea-cfde-425b-9544-abe1fc551f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1813051201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b29f2d-bb4b-4cd1-9b97-d1418a19b328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065b406d985b473497cd9d65a42c6d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:42Z,use_quota=True,user_id='1f6d2721d21b4edfb05ab7a9a34df744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afea428a-6de1-468b-8ae4-9cc6d6a06359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afea428a-6de1-468b-8ae4-9cc6d6a06359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1082e8f9-fbcc-4e55-a7ef-0233070e9043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1082e8f9-fbcc-4e55-a7ef-0233070e9043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b29f2d-bb4b-4cd1-9b97-d1418a19b328', 'volume_name': 'volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef0d32d-9036-4d94-944a-6b7042df269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef0d32d-9036-4d94-944a-6b7042df269d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d7e123-9be6-40b4-9db1-5d471e820cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:42 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Volume 34b29f2d-bb4b-4cd1-9b97-d1418a19b328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328', 'volume_size': 1} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1813051201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b29f2d-bb4b-4cd1-9b97-d1418a19b328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065b406d985b473497cd9d65a42c6d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:42Z,use_quota=True,user_id='1f6d2721d21b4edfb05ab7a9a34df744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Creating volume 34b29f2d-bb4b-4cd1-9b97-d1418a19b328 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:42 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:42 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 1073741824 Nov 02 09:58:42 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Flow 'volume_create_manager' (8389655f-c8b5-493c-8344-80ca2cdd2a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ce36c8-4b9d-476f-9077-a254a4f083c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ce36c8-4b9d-476f-9077-a254a4f083c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1661267818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6f0db6-69cd-41d5-b05f-3b8429639942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fe3b1f6087434f90bda1a9713182f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:42Z,use_quota=True,user_id='a3a46ee212cb49f3a16c1c85b5f22e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f542190-26b0-436b-864a-a257b2bbea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f542190-26b0-436b-864a-a257b2bbea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2b1f25-ce45-4c9b-ab25-9e68896d4596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2b1f25-ce45-4c9b-ab25-9e68896d4596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d6f0db6-69cd-41d5-b05f-3b8429639942', 'volume_name': 'volume-6d6f0db6-69cd-41d5-b05f-3b8429639942', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55aa0953-7870-47d6-88f0-294d7c7fb5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55aa0953-7870-47d6-88f0-294d7c7fb5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd351541-3ba6-4b78-96e5-1c874bc0c0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:43 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Volume 6d6f0db6-69cd-41d5-b05f-3b8429639942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d6f0db6-69cd-41d5-b05f-3b8429639942', 'volume_size': 1} Nov 02 09:58:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:43 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 1073741824" returned: 0 in 0.792s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:43 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 Nov 02 09:58:43 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:44 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" returned: 0 in 0.521s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1661267818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6f0db6-69cd-41d5-b05f-3b8429639942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fe3b1f6087434f90bda1a9713182f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:42Z,use_quota=True,user_id='a3a46ee212cb49f3a16c1c85b5f22e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Creating volume 6d6f0db6-69cd-41d5-b05f-3b8429639942 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:44 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:44 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 1073741824 Nov 02 09:58:44 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d7e123-9be6-40b4-9db1-5d471e820cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d4686d-33a1-48c8-a255-dd97006d96bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:44 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Volume volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 (34b29f2d-bb4b-4cd1-9b97-d1418a19b328): created successfully Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d4686d-33a1-48c8-a255-dd97006d96bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Flow 'volume_create_manager' (fabb801a-463b-4948-9217-0d21f1972c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-66be9dcf-3060-43e6-a3d0-309da990d302 req-b550f32c-c115-4627-81d9-5511329bfbcc tempest-VolumesSnapshotsTestJSON-1942005184 None] Created volume successfully. Nov 02 09:58:44 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 1073741824" returned: 0 in 0.760s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:44 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 Nov 02 09:58:44 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:45 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942" returned: 0 in 0.501s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd351541-3ba6-4b78-96e5-1c874bc0c0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6f0db6-69cd-41d5-b05f-3b8429639942', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f1d1b2-3c50-4b78-9ef8-4a2fdc1b782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:45 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Volume volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 (6d6f0db6-69cd-41d5-b05f-3b8429639942): created successfully Nov 02 09:58:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f1d1b2-3c50-4b78-9ef8-4a2fdc1b782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Flow 'volume_create_manager' (8389655f-c8b5-493c-8344-80ca2cdd2a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cc13a168-ef4e-4b70-9f69-3f1572d05432 tempest-TaggedAttachmentsTest-664524282 None] Created volume successfully. Nov 02 09:58:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Creating offline snapshot 425e20fd-e68f-404a-b2c1-a628445ee00e of volume 34b29f2d-bb4b-4cd1-9b97-d1418a19b328 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:58:46 devstack cinder-volume[86840]: INFO oslo.privsep.daemon [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr0jzd4r7/privsep.sock'] Nov 02 09:58:46 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr0jzd4r7/privsep.sock Nov 02 09:58:46 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:48 devstack cinder-volume[86840]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 09:58:48 devstack cinder-volume[86840]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:58:48 devstack cinder-volume[86840]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 09:58:48 devstack cinder-volume[86840]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 09:58:48 devstack cinder-volume[86840]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:58:48 devstack cinder-volume[86840]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 09:58:48 devstack cinder-volume[86840]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:58:48 devstack cinder-volume[86840]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 09:58:48 devstack cinder-volume[86840]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 09:58:48 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:48 devstack cinder-volume[86840]: INFO oslo.privsep.daemon [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Spawned new privsep daemon via rootwrap Nov 02 09:58:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Accepted privsep connection to /tmp/tmpr0jzd4r7/privsep.sock {{(pid=86840) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 09:58:48 devstack cinder-volume[86840]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 09:58:48 devstack cinder-volume[86840]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 09:58:48 devstack cinder-volume[86840]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 09:58:48 devstack cinder-volume[86840]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87654 Nov 02 09:58:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e85c790-402a-4a01-a0e8-cf6fa38cbb05]: (2,) {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f469bf6-e666-4231-b51b-b475a0f0750a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:48 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 Nov 02 09:58:48 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:49 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" returned: 0 in 1.040s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:49 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e 1G Nov 02 09:58:49 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:50 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e 1G" returned: 0 in 0.683s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:50 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e Nov 02 09:58:50 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:50 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e" returned: 0 in 0.512s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:50 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e is being set with open permissions: ugo+rw Nov 02 09:58:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:50 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e Nov 02 09:58:50 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:51 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e" returned: 0 in 0.566s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:51 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.info Nov 02 09:58:51 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:52 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.info" returned: 0 in 0.788s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:52 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.info is being set with open permissions: ugo+rw Nov 02 09:58:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:52 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.info Nov 02 09:58:52 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:52 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.info" returned: 0 in 0.299s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.267s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-7b514adb-b9a6-4388-81e8-266a42c3b890 req-361c58b3-0b20-470b-873f-f1d3f63a8031 tempest-VolumesSnapshotsTestJSON-1942005184 None] Create snapshot completed successfully Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Acquiring lock "cinder-425e20fd-e68f-404a-b2c1-a628445ee00e-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-425e20fd-e68f-404a-b2c1-a628445ee00e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Acquiring lock "cinder-quobyte-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-quobyte-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Acquiring lock "cinder-quobyte-425e20fd-e68f-404a-b2c1-a628445ee00e" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-quobyte-425e20fd-e68f-404a-b2c1-a628445ee00e" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Deleting offline snapshot 425e20fd-e68f-404a-b2c1-a628445ee00e of volume 34b29f2d-bb4b-4cd1-9b97-d1418a19b328 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] snapshot_file for this snap is: volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc075af6-5788-4db5-9a06-ea62727f833e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:54 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e Nov 02 09:58:54 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e" returned: 0 in 0.633s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:58:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b9395a-cb1f-412f-b8df-390034ba5d18]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:54 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 Nov 02 09:58:54 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:55 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" returned: 0 in 0.608s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:55 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e Nov 02 09:58:55 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:55 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e" returned: 0 in 0.823s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:56 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e Nov 02 09:58:56 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:56 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328.425e20fd-e68f-404a-b2c1-a628445ee00e" returned: 0 in 0.738s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-quobyte-425e20fd-e68f-404a-b2c1-a628445ee00e" released by "_delete_snapshot" :: held 3.295s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-quobyte-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" released by "delete_snapshot" :: held 3.402s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:57 devstack cinder-volume[86840]: WARNING cinder.quota [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:58:57 devstack cinder-volume[86840]: WARNING cinder.quota [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:58:57 devstack cinder-volume[86840]: DEBUG cinder.quota [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Created reservations ['a15a6f76-fdbd-4303-a4ac-b1b8c05056eb', '3287814f-7f90-4dde-91d1-b7576d69bd35', '0deed962-1a4e-44f0-968c-904d4f1fa44b', '58138650-12cd-41e7-8384-40672f69fdff'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:57 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Delete snapshot completed successfully. Nov 02 09:58:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-e3cd9656-4086-439c-b8a7-d3055348e835 req-18c589a0-2055-4baf-96e4-b9bcf5f1fa1a tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-425e20fd-e68f-404a-b2c1-a628445ee00e-delete_snapshot" released by "delete_snapshot" :: held 3.945s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Acquiring lock "cinder-34b29f2d-bb4b-4cd1-9b97-d1418a19b328-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-34b29f2d-bb4b-4cd1-9b97-d1418a19b328-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Acquiring lock "cinder-quobyte-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-quobyte-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1e1de7-ddad-4ffe-80a5-048508ccf682]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:00 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 Nov 02 09:59:00 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:00 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" returned: 0 in 0.581s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:00 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328 Nov 02 09:59:00 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:01 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" returned: 0 in 0.365s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-quobyte-34b29f2d-bb4b-4cd1-9b97-d1418a19b328" released by "delete_volume" :: held 1.048s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:01 devstack cinder-volume[86840]: WARNING cinder.quota [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:59:01 devstack cinder-volume[86840]: DEBUG cinder.quota [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Created reservations ['ac68188c-26a3-4709-a461-d0d1028a6063', 'ca9b9c6b-5f5f-400d-8791-cc7234b2d799', 'b93f193e-3598-4ec7-9ef4-14482a4bee7f', 'be3b2806-a1eb-45b8-af32-d18e2de43f32'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:01 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:59:01 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:02 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.385s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:02 devstack cinder-volume[86840]: DEBUG cinder.manager [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Deleted volume successfully. Nov 02 09:59:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-bfda40f4-1fe7-4c84-95ca-b19fd078e120 req-d8a5c0a2-185a-40e8-b93a-cb9c5b66b4bb tempest-VolumesSnapshotsTestJSON-1942005184 None] Lock "cinder-34b29f2d-bb4b-4cd1-9b97-d1418a19b328-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:11 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=19,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Flow 'volume_create_manager' (75403461-ccd3-422b-933c-1d5552029bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd86fb2-975c-402b-9338-e5cc3328f21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd86fb2-975c-402b-9338-e5cc3328f21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1971785311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a0c261-1b06-48e9-8037-6dc806fd8fb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='548a73b539064b06b370b999c647014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:12Z,use_quota=True,user_id='835b1b98efc4460f9b5877f1a53238ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c105042-58f3-4fdb-ad34-08c4e9a3eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c105042-58f3-4fdb-ad34-08c4e9a3eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0906e4-0795-4a8d-9510-953c31055d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0906e4-0795-4a8d-9510-953c31055d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1a0c261-1b06-48e9-8037-6dc806fd8fb0', 'volume_name': 'volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd184bf5-0034-41e6-9e5a-c6e07a3215bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd184bf5-0034-41e6-9e5a-c6e07a3215bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bcd358-6922-41fe-9058-d97fb2407465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:12 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Volume c1a0c261-1b06-48e9-8037-6dc806fd8fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0', 'volume_size': 1} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1971785311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a0c261-1b06-48e9-8037-6dc806fd8fb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='548a73b539064b06b370b999c647014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:12Z,use_quota=True,user_id='835b1b98efc4460f9b5877f1a53238ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Creating volume c1a0c261-1b06-48e9-8037-6dc806fd8fb0 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:12 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:59:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:12 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 1073741824 Nov 02 09:59:12 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:14 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 1073741824" returned: 0 in 1.250s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:14 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 Nov 02 09:59:14 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:14 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0" returned: 0 in 0.660s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bcd358-6922-41fe-9058-d97fb2407465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0aa8372-b9ef-4fe7-8f89-d381fb3e2052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:14 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Volume volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 (c1a0c261-1b06-48e9-8037-6dc806fd8fb0): created successfully Nov 02 09:59:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0aa8372-b9ef-4fe7-8f89-d381fb3e2052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Flow 'volume_create_manager' (75403461-ccd3-422b-933c-1d5552029bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-597ea08d-c206-457f-b9b7-7a0644917091 tempest-VolumesTestJSON-109114810 None] Created volume successfully. Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Flow 'volume_create_manager' (ba7133ed-e091-460a-a089-c9b9b1566f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1701199b-a4a0-4bd3-899b-94ce26681c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1701199b-a4a0-4bd3-899b-94ce26681c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1676574662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738dcebe-29c7-4f2b-b132-97386d48cd20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='548a73b539064b06b370b999c647014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:17Z,use_quota=True,user_id='835b1b98efc4460f9b5877f1a53238ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddf54e4-6358-4a07-8610-2c21c0e07ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddf54e4-6358-4a07-8610-2c21c0e07ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631f34f2-0f08-4777-a4ce-6b90cf58b1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631f34f2-0f08-4777-a4ce-6b90cf58b1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738dcebe-29c7-4f2b-b132-97386d48cd20', 'volume_name': 'volume-738dcebe-29c7-4f2b-b132-97386d48cd20', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92db60c7-762a-40fc-a8a8-1c92b5b31048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92db60c7-762a-40fc-a8a8-1c92b5b31048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5cf0b0-c2de-42df-9a7b-ea6416d55253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:17 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Volume 738dcebe-29c7-4f2b-b132-97386d48cd20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738dcebe-29c7-4f2b-b132-97386d48cd20', 'volume_size': 1} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1676574662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738dcebe-29c7-4f2b-b132-97386d48cd20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='548a73b539064b06b370b999c647014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:17Z,use_quota=True,user_id='835b1b98efc4460f9b5877f1a53238ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Creating volume 738dcebe-29c7-4f2b-b132-97386d48cd20 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:17 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:59:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:17 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20 1073741824 Nov 02 09:59:17 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:18 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20 1073741824" returned: 0 in 0.923s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:18 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20 Nov 02 09:59:18 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:19 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20" returned: 0 in 0.627s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5cf0b0-c2de-42df-9a7b-ea6416d55253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738dcebe-29c7-4f2b-b132-97386d48cd20', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8892ea2a-a4ae-4d26-9aa2-e11452d1f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:19 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Volume volume-738dcebe-29c7-4f2b-b132-97386d48cd20 (738dcebe-29c7-4f2b-b132-97386d48cd20): created successfully Nov 02 09:59:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8892ea2a-a4ae-4d26-9aa2-e11452d1f99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Flow 'volume_create_manager' (ba7133ed-e091-460a-a089-c9b9b1566f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bf1b212c-cbd0-486e-967f-6c3e5b0a403a tempest-VolumesTestJSON-109114810 None] Created volume successfully. Nov 02 09:59:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:59:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:20 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:59:20 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:21 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.534s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:59:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 8 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:59:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Flow 'volume_create_manager' (2ac2bf2b-36bf-4454-aca6-4bc8c4ae7703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f0fac0-a203-4d1d-a643-118911d55371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f0fac0-a203-4d1d-a643-118911d55371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-980019780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f3ab1e3-b38d-42eb-8bf3-498f01fae880,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='548a73b539064b06b370b999c647014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:22Z,use_quota=True,user_id='835b1b98efc4460f9b5877f1a53238ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e1105c-7f36-4a9b-8994-5a349e67a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e1105c-7f36-4a9b-8994-5a349e67a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61240725-8bc6-4815-bb65-da54a186d495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61240725-8bc6-4815-bb65-da54a186d495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f3ab1e3-b38d-42eb-8bf3-498f01fae880', 'volume_name': 'volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbc3cf2-3e72-4042-b9ed-4415b6dc75b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbc3cf2-3e72-4042-b9ed-4415b6dc75b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef44ca2-3844-44b3-b8ac-7a1d5a4abc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Volume 4f3ab1e3-b38d-42eb-8bf3-498f01fae880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880', 'volume_size': 1} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-980019780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f3ab1e3-b38d-42eb-8bf3-498f01fae880,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='548a73b539064b06b370b999c647014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:22Z,use_quota=True,user_id='835b1b98efc4460f9b5877f1a53238ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Creating volume 4f3ab1e3-b38d-42eb-8bf3-498f01fae880 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:22 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:22 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 1073741824 Nov 02 09:59:22 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Flow 'volume_create_manager' (48c065d4-2597-4ab5-8cca-cbdea36761b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde5b2b2-86a0-410e-98e4-0e4129a49172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde5b2b2-86a0-410e-98e4-0e4129a49172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1261239141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf9833e-78ac-49df-8dd9-0cea56aea607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9725d221f993456b9c04adf108c11cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:22Z,use_quota=True,user_id='f6ffb701479b45d2ac3f0bf1a31b4736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b4bbd9-6c8a-45c7-bd96-8839785a0f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b4bbd9-6c8a-45c7-bd96-8839785a0f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536cbbff-f895-4286-b0d0-f1d8d96150e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536cbbff-f895-4286-b0d0-f1d8d96150e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf9833e-78ac-49df-8dd9-0cea56aea607', 'volume_name': 'volume-0bf9833e-78ac-49df-8dd9-0cea56aea607', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea2c3d2-56b2-426b-8f86-ca789212c039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea2c3d2-56b2-426b-8f86-ca789212c039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604515ec-04d2-47b5-a5f6-7c967383aa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:22 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Volume 0bf9833e-78ac-49df-8dd9-0cea56aea607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf9833e-78ac-49df-8dd9-0cea56aea607', 'volume_size': 1} Nov 02 09:59:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:23 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 1073741824" returned: 0 in 0.890s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:23 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 Nov 02 09:59:23 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:23 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880" returned: 0 in 0.296s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.904s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1261239141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf9833e-78ac-49df-8dd9-0cea56aea607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9725d221f993456b9c04adf108c11cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:22Z,use_quota=True,user_id='f6ffb701479b45d2ac3f0bf1a31b4736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Creating volume 0bf9833e-78ac-49df-8dd9-0cea56aea607 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:23 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:23 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 1073741824 Nov 02 09:59:23 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef44ca2-3844-44b3-b8ac-7a1d5a4abc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f3a346-f8b1-4216-b5ee-aff961afd3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:23 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Volume volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 (4f3ab1e3-b38d-42eb-8bf3-498f01fae880): created successfully Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f3a346-f8b1-4216-b5ee-aff961afd3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Flow 'volume_create_manager' (2ac2bf2b-36bf-4454-aca6-4bc8c4ae7703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:23 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-704d542e-8d82-44ea-9cab-702aa4a469d4 tempest-VolumesTestJSON-109114810 None] Created volume successfully. Nov 02 09:59:24 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 1073741824" returned: 0 in 0.710s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:24 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 Nov 02 09:59:24 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:24 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607" returned: 0 in 0.478s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604515ec-04d2-47b5-a5f6-7c967383aa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf9833e-78ac-49df-8dd9-0cea56aea607', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ad12c4-6f56-4a67-b269-4d1c09934bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:24 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Volume volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 (0bf9833e-78ac-49df-8dd9-0cea56aea607): created successfully Nov 02 09:59:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ad12c4-6f56-4a67-b269-4d1c09934bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Flow 'volume_create_manager' (48c065d4-2597-4ab5-8cca-cbdea36761b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:24 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a176cf76-e00a-4492-af2c-21eefe71f43d tempest-ServersNegativeTestJSON-235957114 None] Created volume successfully. Nov 02 09:59:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Acquiring lock "cinder-4f3ab1e3-b38d-42eb-8bf3-498f01fae880-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Lock "cinder-4f3ab1e3-b38d-42eb-8bf3-498f01fae880-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Acquiring lock "cinder-quobyte-4f3ab1e3-b38d-42eb-8bf3-498f01fae880" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Lock "cinder-quobyte-4f3ab1e3-b38d-42eb-8bf3-498f01fae880" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:26 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a54f33-1041-4051-998d-201f03c59033]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:26 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 Nov 02 09:59:26 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:27 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880" returned: 0 in 0.570s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:27 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880 Nov 02 09:59:27 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Flow 'volume_create_manager' (6352cb0f-72ce-4ba4-a6c9-4906270b5a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd86029b-68c7-4876-9a71-1f6a7daf52a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd86029b-68c7-4876-9a71-1f6a7daf52a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1226774296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bb537f-6c8c-4e4f-bca5-904bd419355e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9725d221f993456b9c04adf108c11cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:27Z,use_quota=True,user_id='f6ffb701479b45d2ac3f0bf1a31b4736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce24642-a24e-4603-9ed7-7ae42addf029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce24642-a24e-4603-9ed7-7ae42addf029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b8ee7e-dc99-4d05-8d74-87a903bd2606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b8ee7e-dc99-4d05-8d74-87a903bd2606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5bb537f-6c8c-4e4f-bca5-904bd419355e', 'volume_name': 'volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557690cf-5a69-4c0b-bb1b-7670787aae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557690cf-5a69-4c0b-bb1b-7670787aae14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91d5b1e-cd59-434f-9693-e391f1b4cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:27 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Volume d5bb537f-6c8c-4e4f-bca5-904bd419355e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e', 'volume_size': 1} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1226774296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bb537f-6c8c-4e4f-bca5-904bd419355e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9725d221f993456b9c04adf108c11cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:27Z,use_quota=True,user_id='f6ffb701479b45d2ac3f0bf1a31b4736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Creating volume d5bb537f-6c8c-4e4f-bca5-904bd419355e {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:27 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:27 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e 1073741824 Nov 02 09:59:27 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:27 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4f3ab1e3-b38d-42eb-8bf3-498f01fae880" returned: 0 in 0.487s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Lock "cinder-quobyte-4f3ab1e3-b38d-42eb-8bf3-498f01fae880" released by "delete_volume" :: held 1.166s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Created reservations ['681cef45-e85a-4f64-b616-7dbeda4cdd1d', '7092e3b3-0f2a-4b6a-a06b-f8135cbcb867', '8b08625d-88c0-4bfd-b32a-2188a1f395ed', 'bb3567de-72b1-41b4-b63c-09e9fe97b0de'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:28 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:59:28 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:28 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e 1073741824" returned: 0 in 0.760s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:28 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e Nov 02 09:59:28 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:28 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.493s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Deleted volume successfully. Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1c5b603f-7759-4fa7-9d4f-e3e45b4c2bfe tempest-VolumesTestJSON-109114810 None] Lock "cinder-4f3ab1e3-b38d-42eb-8bf3-498f01fae880-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:28 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e" returned: 0 in 0.428s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91d5b1e-cd59-434f-9693-e391f1b4cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74626ccd-6f56-4fee-818f-a27b3057e91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:29 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Volume volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e (d5bb537f-6c8c-4e4f-bca5-904bd419355e): created successfully Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74626ccd-6f56-4fee-818f-a27b3057e91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Flow 'volume_create_manager' (6352cb0f-72ce-4ba4-a6c9-4906270b5a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Acquiring lock "cinder-738dcebe-29c7-4f2b-b132-97386d48cd20-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:29 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b7f9cc52-dd73-48a1-a023-af3ca37544e5 tempest-ServersNegativeTestJSON-235957114 None] Created volume successfully. Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Lock "cinder-738dcebe-29c7-4f2b-b132-97386d48cd20-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Acquiring lock "cinder-quobyte-738dcebe-29c7-4f2b-b132-97386d48cd20" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Lock "cinder-quobyte-738dcebe-29c7-4f2b-b132-97386d48cd20" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[804bd5e8-c3a8-429a-b834-0d35cb68a472]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:29 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20 Nov 02 09:59:29 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:29 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20" returned: 0 in 0.585s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:29 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20 Nov 02 09:59:29 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:30 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-738dcebe-29c7-4f2b-b132-97386d48cd20" returned: 0 in 0.453s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Lock "cinder-quobyte-738dcebe-29c7-4f2b-b132-97386d48cd20" released by "delete_volume" :: held 1.124s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Created reservations ['53a69483-b838-4031-bd56-0efe66853a21', '15798389-0cca-4b47-a084-782b861372b2', '72b982ed-4817-4270-91e2-354cedac11bb', '2bbc111a-9551-4207-a821-2e751b6db667'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "cinder-d5bb537f-6c8c-4e4f-bca5-904bd419355e-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Lock "cinder-d5bb537f-6c8c-4e4f-bca5-904bd419355e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "cinder-quobyte-d5bb537f-6c8c-4e4f-bca5-904bd419355e" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Lock "cinder-quobyte-d5bb537f-6c8c-4e4f-bca5-904bd419355e" acquired by "delete_volume" :: waited 0.049s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ea791-8dc1-413b-ab5b-d6dd67b173c1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:30 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:59:30 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:30 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e Nov 02 09:59:30 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:31 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.413s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Deleted volume successfully. Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2e18eab3-c230-43a6-a018-c238c620a103 tempest-VolumesTestJSON-109114810 None] Lock "cinder-738dcebe-29c7-4f2b-b132-97386d48cd20-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:31 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e" returned: 0 in 0.644s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:31 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e Nov 02 09:59:31 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Acquiring lock "cinder-c1a0c261-1b06-48e9-8037-6dc806fd8fb0-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Lock "cinder-c1a0c261-1b06-48e9-8037-6dc806fd8fb0-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Acquiring lock "cinder-quobyte-c1a0c261-1b06-48e9-8037-6dc806fd8fb0" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Lock "cinder-quobyte-c1a0c261-1b06-48e9-8037-6dc806fd8fb0" acquired by "delete_volume" :: waited 0.047s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c209349f-db27-4026-84f6-1b6f9018cb4a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:31 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d5bb537f-6c8c-4e4f-bca5-904bd419355e" returned: 0 in 0.525s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:31 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 Nov 02 09:59:31 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Lock "cinder-quobyte-d5bb537f-6c8c-4e4f-bca5-904bd419355e" released by "delete_volume" :: held 1.265s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:31 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Created reservations ['b24d1518-2cbb-40a9-a91f-63a4c3022e66', '74b678f2-e02a-4025-bffb-d8c083c7783b', '574477e8-8550-4ddb-b596-c8d1fbaf0a98', '21a38584-9071-4798-9d30-fd253787325f'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:32 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:59:32 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:32 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0" returned: 0 in 0.425s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:32 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0 Nov 02 09:59:32 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:32 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.298s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:32 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Deleted volume successfully. Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e7fe07c5-83a1-43a0-a84d-3b516c19c12b tempest-ServersNegativeTestJSON-235957114 None] Lock "cinder-d5bb537f-6c8c-4e4f-bca5-904bd419355e-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:32 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c1a0c261-1b06-48e9-8037-6dc806fd8fb0" returned: 0 in 0.314s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Lock "cinder-quobyte-c1a0c261-1b06-48e9-8037-6dc806fd8fb0" released by "delete_volume" :: held 0.798s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Created reservations ['e7943749-9764-450a-accc-ffc8ce81bf8e', '7a905eaf-e723-4009-82f3-234695f8b577', '8985b202-9993-4383-99ba-19388e35362b', '2c9e0096-82e4-4a2d-81b3-60b79c993dba'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:32 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:59:32 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "cinder-0bf9833e-78ac-49df-8dd9-0cea56aea607-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Lock "cinder-0bf9833e-78ac-49df-8dd9-0cea56aea607-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "cinder-quobyte-0bf9833e-78ac-49df-8dd9-0cea56aea607" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Lock "cinder-quobyte-0bf9833e-78ac-49df-8dd9-0cea56aea607" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f6450e-f43d-4065-a140-13175bc1f73b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:33 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.386s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Deleted volume successfully. Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee1fab52-0b98-45fc-b900-e0f35d3f703c tempest-VolumesTestJSON-109114810 None] Lock "cinder-c1a0c261-1b06-48e9-8037-6dc806fd8fb0-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:33 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 Nov 02 09:59:33 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:33 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607" returned: 0 in 0.484s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:33 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607 Nov 02 09:59:33 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:33 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0bf9833e-78ac-49df-8dd9-0cea56aea607" returned: 0 in 0.312s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Lock "cinder-quobyte-0bf9833e-78ac-49df-8dd9-0cea56aea607" released by "delete_volume" :: held 0.871s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:33 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Created reservations ['20837118-86aa-40c9-8a16-14be088ecdb9', 'e95bae72-6e74-4b7a-94c4-ee47fe4f0b74', '08f3559a-c20e-47ab-bc31-1402fd0a6256', '1256efe0-ae6a-42c2-b75c-b4a76896ba82'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:34 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:59:34 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:34 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.316s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:34 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Deleted volume successfully. Nov 02 09:59:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3fde2cf-1270-4b47-9753-5af4ab23cb77 tempest-ServersNegativeTestJSON-235957114 None] Lock "cinder-0bf9833e-78ac-49df-8dd9-0cea56aea607-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2bcab7c6-d134-4674-8201-ca69b641ff43 tempest-GroupsTest-1446881019 None] Group tempest-Group1-603553797: creating Nov 02 09:59:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2bcab7c6-d134-4674-8201-ca69b641ff43 tempest-GroupsTest-1446881019 None] Group tempest-Group1-603553797: created successfully Nov 02 09:59:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2bcab7c6-d134-4674-8201-ca69b641ff43 tempest-GroupsTest-1446881019 None] Create group completed successfully. Nov 02 09:59:40 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ded7b223-eda3-48cd-81c4-9a2d53ad8185 tempest-GroupsTest-1446881019 None] Group tempest-Group2-827345630: creating Nov 02 09:59:40 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ded7b223-eda3-48cd-81c4-9a2d53ad8185 tempest-GroupsTest-1446881019 None] Group tempest-Group2-827345630: created successfully Nov 02 09:59:41 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ded7b223-eda3-48cd-81c4-9a2d53ad8185 tempest-GroupsTest-1446881019 None] Create group completed successfully. Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Flow 'volume_create_manager' (130cc296-6211-4ac7-830b-e23ec514b78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7c3863-5601-420b-a0d4-6513ca544923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7c3863-5601-420b-a0d4-6513ca544923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873619472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=371d5368-3585-4b8c-a555-901291a0145f,host='devstack@QuobyteHD#QuobyteHD',id=f3153808-fd14-49b1-ad4e-8de016745b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29484b7e90bf4db693d4b1eda86d38b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:43Z,use_quota=True,user_id='a213b16e613047eeb3cca17b0b5f25ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99221d93-d246-424b-8b02-378860209326),volume_type_id=99221d93-d246-424b-8b02-378860209326)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f329af7a-ceee-40dc-88c4-6c38213e1ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f329af7a-ceee-40dc-88c4-6c38213e1ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f757cc-cb3f-449e-8faf-1b1dee4de701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f757cc-cb3f-449e-8faf-1b1dee4de701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3153808-fd14-49b1-ad4e-8de016745b46', 'volume_name': 'volume-f3153808-fd14-49b1-ad4e-8de016745b46', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7f755e-e3f2-4d3a-9006-0b5c78ac3948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7f755e-e3f2-4d3a-9006-0b5c78ac3948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5952a1b-45ad-42eb-a87e-ef59d4971dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:42 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Volume f3153808-fd14-49b1-ad4e-8de016745b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3153808-fd14-49b1-ad4e-8de016745b46', 'volume_size': 1} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=371d5368-3585-4b8c-a555-901291a0145f,created_at=2026-11-02T08:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873619472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=371d5368-3585-4b8c-a555-901291a0145f,host='devstack@QuobyteHD#QuobyteHD',id=f3153808-fd14-49b1-ad4e-8de016745b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29484b7e90bf4db693d4b1eda86d38b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:43Z,use_quota=True,user_id='a213b16e613047eeb3cca17b0b5f25ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99221d93-d246-424b-8b02-378860209326),volume_type_id=99221d93-d246-424b-8b02-378860209326)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Creating volume f3153808-fd14-49b1-ad4e-8de016745b46 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:42 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:59:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:42 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46 1073741824 Nov 02 09:59:42 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:43 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46 1073741824" returned: 0 in 0.593s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:43 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46 Nov 02 09:59:43 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:44 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46" returned: 0 in 0.447s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5952a1b-45ad-42eb-a87e-ef59d4971dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3153808-fd14-49b1-ad4e-8de016745b46', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84bc866-8c61-403d-86e9-6e6b83fd1bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:44 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Volume volume-f3153808-fd14-49b1-ad4e-8de016745b46 (f3153808-fd14-49b1-ad4e-8de016745b46): created successfully Nov 02 09:59:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84bc866-8c61-403d-86e9-6e6b83fd1bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Flow 'volume_create_manager' (130cc296-6211-4ac7-830b-e23ec514b78b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d792ce5f-4fec-4ea0-a0eb-6149c372313a tempest-GroupsTest-1446881019 None] Created volume successfully. Nov 02 09:59:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Acquiring lock "cinder-quobyte-f3153808-fd14-49b1-ad4e-8de016745b46" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Lock "cinder-quobyte-f3153808-fd14-49b1-ad4e-8de016745b46" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:46 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db76f8a-df71-4334-a640-2df249cae232]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:47 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46 Nov 02 09:59:47 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:47 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46" returned: 0 in 0.573s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:47 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46 Nov 02 09:59:47 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:47 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f3153808-fd14-49b1-ad4e-8de016745b46" returned: 0 in 0.406s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Lock "cinder-quobyte-f3153808-fd14-49b1-ad4e-8de016745b46" released by "delete_volume" :: held 1.062s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Created reservations ['836cebdf-a02c-47ef-b34f-5707a1a98b24'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:48 devstack cinder-volume[86840]: WARNING cinder.quota [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1701189990 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1701189990, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:59:48 devstack cinder-volume[86840]: WARNING cinder.quota [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1701189990 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1701189990, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Created reservations ['8b5f381e-5d7d-45b7-a0d7-69ed2047a4e6', '4bac0e7f-0fd3-47e4-a279-90ab10d31411', '82ef4482-de73-4a0a-a90d-6debd865a0f2', 'd3b08ef2-7697-4079-82ff-07b57157bdc6'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:48 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:59:48 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:48 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.401s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:48 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3750a90c-3d11-465b-ab3d-18a3fc23691b tempest-GroupsTest-1446881019 None] Delete group completed successfully. Nov 02 09:59:49 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] Created reservations ['33084c4c-a630-4281-a5aa-1aa1de59c301'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:49 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 09:59:49 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:50 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.480s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:50 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:50 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1486e6c3-9486-4b9f-9df5-3e159c848c38 tempest-GroupsTest-1446881019 None] Delete group completed successfully. Nov 02 09:59:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f7c4dfc9-ff01-4c11-9c00-ba089cfa4c74 tempest-GroupsTest-1446881019 None] Group tempest-GroupsTest-Group-289394023: creating Nov 02 09:59:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f7c4dfc9-ff01-4c11-9c00-ba089cfa4c74 tempest-GroupsTest-1446881019 None] Group tempest-GroupsTest-Group-289394023: created successfully Nov 02 09:59:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f7c4dfc9-ff01-4c11-9c00-ba089cfa4c74 tempest-GroupsTest-1446881019 None] Create group completed successfully. Nov 02 09:59:53 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Flow 'volume_create_manager' (f3c49d59-4e19-4e62-8159-af1f71c92815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d849d-0b6d-41ca-9db2-3bb648870b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d849d-0b6d-41ca-9db2-3bb648870b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1960806854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=375add71-ffcc-45db-bb97-b6ea8a9e51d0,host='devstack@QuobyteHD#QuobyteHD',id=faed1b62-1776-45b3-adcf-c8ba44d938ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29484b7e90bf4db693d4b1eda86d38b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:54Z,use_quota=True,user_id='a213b16e613047eeb3cca17b0b5f25ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(579c36b0-7bfa-4248-9bd1-997404c913c2),volume_type_id=579c36b0-7bfa-4248-9bd1-997404c913c2)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9039eac3-a648-4426-a5c4-67ea275853ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9039eac3-a648-4426-a5c4-67ea275853ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d726fe-c57f-443c-b201-1718009c2ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d726fe-c57f-443c-b201-1718009c2ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faed1b62-1776-45b3-adcf-c8ba44d938ae', 'volume_name': 'volume-faed1b62-1776-45b3-adcf-c8ba44d938ae', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88736fcb-5815-4ed5-801e-aef22420dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88736fcb-5815-4ed5-801e-aef22420dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bab07f-a5a7-4aaa-a897-6868122977f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Volume faed1b62-1776-45b3-adcf-c8ba44d938ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faed1b62-1776-45b3-adcf-c8ba44d938ae', 'volume_size': 1} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=375add71-ffcc-45db-bb97-b6ea8a9e51d0,created_at=2026-11-02T08:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1960806854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=375add71-ffcc-45db-bb97-b6ea8a9e51d0,host='devstack@QuobyteHD#QuobyteHD',id=faed1b62-1776-45b3-adcf-c8ba44d938ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29484b7e90bf4db693d4b1eda86d38b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:54Z,use_quota=True,user_id='a213b16e613047eeb3cca17b0b5f25ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(579c36b0-7bfa-4248-9bd1-997404c913c2),volume_type_id=579c36b0-7bfa-4248-9bd1-997404c913c2)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Creating volume faed1b62-1776-45b3-adcf-c8ba44d938ae {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:54 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:59:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:54 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae 1073741824 Nov 02 09:59:54 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:55 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae 1073741824" returned: 0 in 0.991s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:55 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae Nov 02 09:59:55 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:55 devstack cinder-volume[86840]: WARNING py.warnings [req-79030d5a-a9b0-458b-a1cf-3b4f7e0dafd2 req-9751324d-f835-4920-b02b-218bbd272dff tempest-TaggedAttachmentsTest-664524282 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 02 09:59:55 devstack cinder-volume[86840]: .first() Nov 02 09:59:55 devstack cinder-volume[86840]: Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-79030d5a-a9b0-458b-a1cf-3b4f7e0dafd2 req-9751324d-f835-4920-b02b-218bbd272dff tempest-TaggedAttachmentsTest-664524282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:55 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae" returned: 0 in 0.406s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-79030d5a-a9b0-458b-a1cf-3b4f7e0dafd2 req-9751324d-f835-4920-b02b-218bbd272dff tempest-TaggedAttachmentsTest-664524282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.032s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-79030d5a-a9b0-458b-a1cf-3b4f7e0dafd2 req-9751324d-f835-4920-b02b-218bbd272dff tempest-TaggedAttachmentsTest-664524282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bab07f-a5a7-4aaa-a897-6868122977f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faed1b62-1776-45b3-adcf-c8ba44d938ae', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a753e6-b41b-49d1-8b74-2b68e5d4bfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:55 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Volume volume-faed1b62-1776-45b3-adcf-c8ba44d938ae (faed1b62-1776-45b3-adcf-c8ba44d938ae): created successfully Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a753e6-b41b-49d1-8b74-2b68e5d4bfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Flow 'volume_create_manager' (f3c49d59-4e19-4e62-8159-af1f71c92815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a59d5e1b-aa40-4e8f-8020-76c5ec7e583e tempest-GroupsTest-1446881019 None] Created volume successfully. Nov 02 09:59:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-79030d5a-a9b0-458b-a1cf-3b4f7e0dafd2 req-9751324d-f835-4920-b02b-218bbd272dff tempest-TaggedAttachmentsTest-664524282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-6d6f0db6-69cd-41d5-b05f-3b8429639942', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '406927a5-5a97-4030-80b7-ff328c7e38bf', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:59:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-79030d5a-a9b0-458b-a1cf-3b4f7e0dafd2 req-9751324d-f835-4920-b02b-218bbd272dff tempest-TaggedAttachmentsTest-664524282 None] attachment_update completed successfully. Nov 02 09:59:57 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Flow 'volume_create_manager' (06409e46-c4a7-4fc2-81ce-395cee5b40ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c31da04-9e80-494d-a0f1-4a005c0646ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c31da04-9e80-494d-a0f1-4a005c0646ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036809899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=375add71-ffcc-45db-bb97-b6ea8a9e51d0,host='devstack@QuobyteHD#QuobyteHD',id=9742373c-0eca-45a7-9861-c35024b4fea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29484b7e90bf4db693d4b1eda86d38b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:58Z,use_quota=True,user_id='a213b16e613047eeb3cca17b0b5f25ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(579c36b0-7bfa-4248-9bd1-997404c913c2),volume_type_id=579c36b0-7bfa-4248-9bd1-997404c913c2)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5814c0d0-f7fd-42d8-887b-ee69e42d5d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5814c0d0-f7fd-42d8-887b-ee69e42d5d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b143a0e-1209-4589-aa70-98b5b6778e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b143a0e-1209-4589-aa70-98b5b6778e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9742373c-0eca-45a7-9861-c35024b4fea0', 'volume_name': 'volume-9742373c-0eca-45a7-9861-c35024b4fea0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbb4826-2be8-475f-98e7-465a0b7ee9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbb4826-2be8-475f-98e7-465a0b7ee9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6081c2-5307-45ac-9bff-37ab7f05a1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:58 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Volume 9742373c-0eca-45a7-9861-c35024b4fea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9742373c-0eca-45a7-9861-c35024b4fea0', 'volume_size': 1} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=375add71-ffcc-45db-bb97-b6ea8a9e51d0,created_at=2026-11-02T08:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1036809899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=375add71-ffcc-45db-bb97-b6ea8a9e51d0,host='devstack@QuobyteHD#QuobyteHD',id=9742373c-0eca-45a7-9861-c35024b4fea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29484b7e90bf4db693d4b1eda86d38b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:58Z,use_quota=True,user_id='a213b16e613047eeb3cca17b0b5f25ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(579c36b0-7bfa-4248-9bd1-997404c913c2),volume_type_id=579c36b0-7bfa-4248-9bd1-997404c913c2)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Creating volume 9742373c-0eca-45a7-9861-c35024b4fea0 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:58 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:58 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0 1073741824 Nov 02 09:59:58 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:58 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0 1073741824" returned: 0 in 0.687s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:58 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0 Nov 02 09:59:58 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-32141b72-a0bd-4a49-a9b8-dac93408b3c5 tempest-GroupSnapshotsV319Test-1294351760 None] Group tempest-GroupSnapshotsV319Test-Group-213583694: creating Nov 02 09:59:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-32141b72-a0bd-4a49-a9b8-dac93408b3c5 tempest-GroupSnapshotsV319Test-1294351760 None] Group tempest-GroupSnapshotsV319Test-Group-213583694: created successfully Nov 02 09:59:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-32141b72-a0bd-4a49-a9b8-dac93408b3c5 tempest-GroupSnapshotsV319Test-1294351760 None] Create group completed successfully. Nov 02 09:59:59 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0" returned: 0 in 0.429s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6081c2-5307-45ac-9bff-37ab7f05a1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9742373c-0eca-45a7-9861-c35024b4fea0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17e1613-bae2-41e6-aad9-63d02c89675c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Volume volume-9742373c-0eca-45a7-9861-c35024b4fea0 (9742373c-0eca-45a7-9861-c35024b4fea0): created successfully Nov 02 09:59:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17e1613-bae2-41e6-aad9-63d02c89675c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Flow 'volume_create_manager' (06409e46-c4a7-4fc2-81ce-395cee5b40ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-9bc00360-4fdc-4a3f-93d3-4a57931b689e tempest-GroupsTest-1446881019 None] Created volume successfully. Nov 02 10:00:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-22b6e4c1-3586-42d5-b63b-c6ff2472b973 req-741e41ff-aede-4f35-8a49-edf409334ccf tempest-TaggedAttachmentsTest-664524282 None] Terminate volume connection completed successfully. Nov 02 10:00:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-22b6e4c1-3586-42d5-b63b-c6ff2472b973 req-741e41ff-aede-4f35-8a49-edf409334ccf tempest-TaggedAttachmentsTest-664524282 None] Deleting attachment 406927a5-5a97-4030-80b7-ff328c7e38bf. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:00:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-aaf49f3e-0154-4323-8fc5-13e39539cad3 tempest-GroupsTest-1446881019 None] Update group completed successfully. Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Flow 'volume_create_manager' (50f2e12b-ebe5-40bd-83e1-9f27ab49c0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e1d6e6-c252-482c-85b5-74bc8adec2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e1d6e6-c252-482c-85b5-74bc8adec2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1859140571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9eb05b5c-cbb2-41e8-b046-e66075c06054,host='devstack@QuobyteHD#QuobyteHD',id=af119593-109a-4085-9153-94d704fb1e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555cbd67226f4f95a75ce045ffb1ed14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:01Z,use_quota=True,user_id='c8f910b84c7c43fba5484a9253097a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de8fa45-d5d8-477f-b5c9-5db4c0c39dc8),volume_type_id=9de8fa45-d5d8-477f-b5c9-5db4c0c39dc8)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb65eac-d045-44f0-bfde-5ada09bdd34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb65eac-d045-44f0-bfde-5ada09bdd34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd25fdd-985b-4437-8fd5-490c053bad71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd25fdd-985b-4437-8fd5-490c053bad71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af119593-109a-4085-9153-94d704fb1e69', 'volume_name': 'volume-af119593-109a-4085-9153-94d704fb1e69', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d4ed14-0c3e-437a-b633-c7a503dc08c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d4ed14-0c3e-437a-b633-c7a503dc08c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3864b037-42bf-4167-bd13-b9a66350418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Volume af119593-109a-4085-9153-94d704fb1e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af119593-109a-4085-9153-94d704fb1e69', 'volume_size': 1} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9eb05b5c-cbb2-41e8-b046-e66075c06054,created_at=2026-11-02T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1859140571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9eb05b5c-cbb2-41e8-b046-e66075c06054,host='devstack@QuobyteHD#QuobyteHD',id=af119593-109a-4085-9153-94d704fb1e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555cbd67226f4f95a75ce045ffb1ed14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:01Z,use_quota=True,user_id='c8f910b84c7c43fba5484a9253097a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de8fa45-d5d8-477f-b5c9-5db4c0c39dc8),volume_type_id=9de8fa45-d5d8-477f-b5c9-5db4c0c39dc8)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Creating volume af119593-109a-4085-9153-94d704fb1e69 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:01 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:01 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 1073741824 Nov 02 10:00:01 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:01 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 1073741824" returned: 0 in 0.714s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:02 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 Nov 02 10:00:02 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:02 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69" returned: 0 in 0.365s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3864b037-42bf-4167-bd13-b9a66350418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af119593-109a-4085-9153-94d704fb1e69', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df80ecf4-f41e-4c49-9fe1-81757230d3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Volume volume-af119593-109a-4085-9153-94d704fb1e69 (af119593-109a-4085-9153-94d704fb1e69): created successfully Nov 02 10:00:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df80ecf4-f41e-4c49-9fe1-81757230d3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Flow 'volume_create_manager' (50f2e12b-ebe5-40bd-83e1-9f27ab49c0e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1fd663cb-68ea-4c16-bd30-e7d99101ae2e tempest-GroupSnapshotsV319Test-1294351760 None] Created volume successfully. Nov 02 10:00:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3ab1c71e-058a-468d-8f77-76aecf9fadea tempest-GroupsTest-1446881019 None] Update group completed successfully. Nov 02 10:00:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] GroupSnapshot fb57bf80-9c89-4aa5-9949-1803472d88ad: creating. Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Group snapshot fb57bf80-9c89-4aa5-9949-1803472d88ad: creating. {{(pid=86840) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Creating offline snapshot bc394f9a-ffd5-4588-a50f-9efb72f6523a of volume af119593-109a-4085-9153-94d704fb1e69 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0382a8bf-6deb-4d34-a2bc-56a90f75c30f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:04 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 Nov 02 10:00:04 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Acquiring lock "cinder-quobyte-9742373c-0eca-45a7-9861-c35024b4fea0" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Lock "cinder-quobyte-9742373c-0eca-45a7-9861-c35024b4fea0" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:04 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[142109ec-660c-433c-b26a-afa824edbe9f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69" returned: 0 in 0.731s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:04 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a 1G Nov 02 10:00:04 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:05 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0 Nov 02 10:00:05 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:05 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0" returned: 0 in 0.573s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:05 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0 Nov 02 10:00:05 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:05 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a 1G" returned: 0 in 0.656s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af119593-109a-4085-9153-94d704fb1e69 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:05 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af119593-109a-4085-9153-94d704fb1e69 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a Nov 02 10:00:05 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:05 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9742373c-0eca-45a7-9861-c35024b4fea0" returned: 0 in 0.369s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Lock "cinder-quobyte-9742373c-0eca-45a7-9861-c35024b4fea0" released by "delete_volume" :: held 1.044s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Acquiring lock "cinder-quobyte-faed1b62-1776-45b3-adcf-c8ba44d938ae" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Lock "cinder-quobyte-faed1b62-1776-45b3-adcf-c8ba44d938ae" acquired by "delete_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[da277869-b122-4ca7-a45c-3a1e22beb33a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:05 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af119593-109a-4085-9153-94d704fb1e69 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a" returned: 0 in 0.419s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:05 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:00:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:05 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a Nov 02 10:00:05 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:06 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae Nov 02 10:00:06 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:06 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a" returned: 0 in 0.365s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:06 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.info Nov 02 10:00:06 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:06 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae" returned: 0 in 0.520s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:06 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae Nov 02 10:00:06 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:06 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.info" returned: 0 in 0.334s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:06 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:00:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:06 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.info Nov 02 10:00:06 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:06 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-faed1b62-1776-45b3-adcf-c8ba44d938ae" returned: 0 in 0.367s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Lock "cinder-quobyte-faed1b62-1776-45b3-adcf-c8ba44d938ae" released by "delete_volume" :: held 0.961s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:06 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Created reservations ['e562a323-6bb9-460c-af68-a12a323c60ac'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:07 devstack cinder-volume[86840]: WARNING cinder.quota [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-677683923 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-677683923, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:00:07 devstack cinder-volume[86840]: WARNING cinder.quota [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-677683923 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-677683923, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Created reservations ['f7475279-dfcc-4a9f-bd7b-6f7a040be5c4', 'f12e52a3-17dc-47bc-a38d-29be9b1702c7', 'fa716669-7199-4fa9-bb2f-a1189e4a4f68', '92d76acf-6cc9-441a-a5ca-16aec08acd76'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:07 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.info" returned: 0 in 0.350s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.021s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ab776ce8-809c-44f3-879e-0b28a90d8eca tempest-GroupSnapshotsV319Test-1294351760 None] group_snapshot fb57bf80-9c89-4aa5-9949-1803472d88ad: created successfully Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Created reservations ['c13404c6-3fcc-4d06-86c8-44bbfc1085e7', '5adc58d2-dff2-4a07-9b5e-7732b09f7d26', 'ec48c81a-3db5-4e22-9371-1840bfce745c', 'f093ee54-eb47-4f98-80fc-8041d2dbdf15'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:07 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:00:07 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:08 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.324s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-12fe9930-d0e9-4364-a723-579491a6b3f2 tempest-GroupsTest-1446881019 None] Delete group completed successfully. Nov 02 10:00:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] group_snapshot fb57bf80-9c89-4aa5-9949-1803472d88ad: deleting Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] group_snapshot fb57bf80-9c89-4aa5-9949-1803472d88ad: deleting {{(pid=86840) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Acquiring lock "cinder-quobyte-af119593-109a-4085-9153-94d704fb1e69" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Lock "cinder-quobyte-af119593-109a-4085-9153-94d704fb1e69" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Acquiring lock "cinder-quobyte-bc394f9a-ffd5-4588-a50f-9efb72f6523a" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Lock "cinder-quobyte-bc394f9a-ffd5-4588-a50f-9efb72f6523a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Deleting offline snapshot bc394f9a-ffd5-4588-a50f-9efb72f6523a of volume af119593-109a-4085-9153-94d704fb1e69 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] snapshot_file for this snap is: volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d5368a-6f50-4654-9ec1-ea44c61873c1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:09 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a Nov 02 10:00:09 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:09 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a" returned: 0 in 0.520s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af119593-109a-4085-9153-94d704fb1e69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:00:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[578bcf10-03ae-40eb-b301-8c2b7920c790]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:09 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 Nov 02 10:00:09 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:09 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69" returned: 0 in 0.573s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:10 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a Nov 02 10:00:10 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:10 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a" returned: 0 in 0.516s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:10 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a Nov 02 10:00:10 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:10 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69.bc394f9a-ffd5-4588-a50f-9efb72f6523a" returned: 0 in 0.483s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Lock "cinder-quobyte-bc394f9a-ffd5-4588-a50f-9efb72f6523a" released by "_delete_snapshot" :: held 2.301s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Lock "cinder-quobyte-af119593-109a-4085-9153-94d704fb1e69" released by "delete_snapshot" :: held 2.345s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:11 devstack cinder-volume[86840]: WARNING cinder.quota [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-868805161 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-868805161, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:00:11 devstack cinder-volume[86840]: WARNING cinder.quota [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-868805161 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-868805161, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:00:11 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] Created reservations ['af058b95-1f73-4406-8225-5195c314fadf', '06c03c56-b832-448e-9baf-41692f96cfb9', '7c281e20-e1fa-4124-b9d2-84c6e09f9e42', '51681fb0-fb8b-422e-bfd0-c1f51e1b9791'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:11 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7d8b2769-f8b6-4169-84bc-88d7e8bb35e8 tempest-GroupSnapshotsV319Test-1294351760 None] group_snapshot fb57bf80-9c89-4aa5-9949-1803472d88ad: deleted successfully Nov 02 10:00:12 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=112,cinder:DELETE=5,cinder:SELECT=107,cinder:INSERT=26 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:12 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=95,cinder:INSERT=23,cinder:UPDATE=118,cinder:DELETE=9 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Acquiring lock "cinder-quobyte-af119593-109a-4085-9153-94d704fb1e69" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Lock "cinder-quobyte-af119593-109a-4085-9153-94d704fb1e69" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:12 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2350aeaa-d3d7-431f-aded-60c7e23b0e88]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:13 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 Nov 02 10:00:13 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:13 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69" returned: 0 in 0.469s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:13 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69 Nov 02 10:00:13 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:13 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-af119593-109a-4085-9153-94d704fb1e69" returned: 0 in 0.411s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Lock "cinder-quobyte-af119593-109a-4085-9153-94d704fb1e69" released by "delete_volume" :: held 0.985s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:13 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Created reservations ['1d906ba0-000e-4340-ba69-c4e888c875d6'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:14 devstack cinder-volume[86840]: WARNING cinder.quota [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-868805161 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-868805161, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:00:14 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Created reservations ['fcea36a1-7cff-46b7-8ec1-d5da6746e746', 'ef0b0217-5fcb-4678-a560-63f439d3c844', 'dce40c00-0438-4a2c-a785-e48a1aaf803c', '5dce11ff-7601-43e7-adc1-aeced557e81f'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:14 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:00:14 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:14 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.343s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:14 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:14 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6dafa3e1-4841-4b0c-8890-61a07cfc4c69 tempest-GroupSnapshotsV319Test-1294351760 None] Delete group completed successfully. Nov 02 10:00:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Acquiring lock "cinder-6d6f0db6-69cd-41d5-b05f-3b8429639942-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Lock "cinder-6d6f0db6-69cd-41d5-b05f-3b8429639942-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Acquiring lock "cinder-quobyte-6d6f0db6-69cd-41d5-b05f-3b8429639942" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Lock "cinder-quobyte-6d6f0db6-69cd-41d5-b05f-3b8429639942" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:16 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7fe793-3e25-44b4-b479-1c6131885ff2]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:17 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 Nov 02 10:00:17 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:17 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942" returned: 0 in 0.567s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:17 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942 Nov 02 10:00:17 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:18 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6d6f0db6-69cd-41d5-b05f-3b8429639942" returned: 0 in 0.525s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Lock "cinder-quobyte-6d6f0db6-69cd-41d5-b05f-3b8429639942" released by "delete_volume" :: held 1.184s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Created reservations ['981dba13-e520-4a32-b8a9-1887a13676a2', '562ea47a-c399-4473-92ab-f07cc0eb345a', '31677a80-6bf5-424a-bcb6-82dfc323e9e2', '300361bf-daa6-4b19-92d2-5fb4816cdd8f'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:18 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:00:18 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:18 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.392s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:18 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Deleted volume successfully. Nov 02 10:00:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d070e667-a801-42b9-9bab-3ab4211c6f48 tempest-TaggedAttachmentsTest-664524282 None] Lock "cinder-6d6f0db6-69cd-41d5-b05f-3b8429639942-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7898291a-efa1-4581-b907-b000f0bb174e tempest-GroupsV314Test-126469062 None] Group tempest-GroupsV314Test-Group-1126928228: creating Nov 02 10:00:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7898291a-efa1-4581-b907-b000f0bb174e tempest-GroupsV314Test-126469062 None] Group tempest-GroupsV314Test-Group-1126928228: created successfully Nov 02 10:00:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7898291a-efa1-4581-b907-b000f0bb174e tempest-GroupsV314Test-126469062 None] Create group completed successfully. Nov 02 10:00:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:00:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:20 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:00:20 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:21 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.446s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Flow 'volume_create_manager' (3e8941f6-54c7-4985-870f-23f3aa0f4c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb4cbde-9812-43ed-868d-d5b5a3db7e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb4cbde-9812-43ed-868d-d5b5a3db7e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1104933106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e87d5e0-5286-4090-8249-8b079f250ee9,host='devstack@QuobyteHD#QuobyteHD',id=cc897e38-781a-4b75-b3f3-6ea6836460d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f93c0f3ddbb4b91baa233a34e6ee704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:21Z,use_quota=True,user_id='4e32719bd78d4d58bc984048bb1b7665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(114dcc2f-d6ef-41e5-8ee0-c35b75c52410),volume_type_id=114dcc2f-d6ef-41e5-8ee0-c35b75c52410)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7dbbc0-390c-4022-b6bf-264b0796c380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7dbbc0-390c-4022-b6bf-264b0796c380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa75fb1-5a53-4c98-af59-ffee3eeac655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa75fb1-5a53-4c98-af59-ffee3eeac655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc897e38-781a-4b75-b3f3-6ea6836460d0', 'volume_name': 'volume-cc897e38-781a-4b75-b3f3-6ea6836460d0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177194c6-d1fb-4541-a333-b6f4568c4fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177194c6-d1fb-4541-a333-b6f4568c4fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e609fa1-e502-4493-b11d-d771c0ff015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Volume cc897e38-781a-4b75-b3f3-6ea6836460d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc897e38-781a-4b75-b3f3-6ea6836460d0', 'volume_size': 1} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e87d5e0-5286-4090-8249-8b079f250ee9,created_at=2026-11-02T09:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1104933106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e87d5e0-5286-4090-8249-8b079f250ee9,host='devstack@QuobyteHD#QuobyteHD',id=cc897e38-781a-4b75-b3f3-6ea6836460d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f93c0f3ddbb4b91baa233a34e6ee704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:21Z,use_quota=True,user_id='4e32719bd78d4d58bc984048bb1b7665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(114dcc2f-d6ef-41e5-8ee0-c35b75c52410),volume_type_id=114dcc2f-d6ef-41e5-8ee0-c35b75c52410)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Creating volume cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:21 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:00:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:21 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 1073741824 Nov 02 10:00:21 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:22 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 1073741824" returned: 0 in 0.634s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:22 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 Nov 02 10:00:22 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:22 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0" returned: 0 in 0.275s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e609fa1-e502-4493-b11d-d771c0ff015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc897e38-781a-4b75-b3f3-6ea6836460d0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be473899-8289-440b-b101-14ba09cc2099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:22 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Volume volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 (cc897e38-781a-4b75-b3f3-6ea6836460d0): created successfully Nov 02 10:00:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be473899-8289-440b-b101-14ba09cc2099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Flow 'volume_create_manager' (3e8941f6-54c7-4985-870f-23f3aa0f4c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:22 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-dda0e99d-1484-4c0f-859d-b5c14c7aa0c6 tempest-GroupsV314Test-126469062 None] Created volume successfully. Nov 02 10:00:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:23 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Cloning volume cc897e38-781a-4b75-b3f3-6ea6836460d0 to volume a4ffab20-d788-4af7-9f67-6160cb96aec8 Nov 02 10:00:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Creating offline snapshot 2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 of volume cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:00:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa1aff-bb40-46b7-8edf-9f9d2ce33e25]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:23 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 Nov 02 10:00:23 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:24 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0" returned: 0 in 0.651s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:24 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 1G Nov 02 10:00:24 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:24 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 1G" returned: 0 in 0.598s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:24 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 Nov 02 10:00:24 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:25 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3" returned: 0 in 0.582s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:25 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:00:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:25 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 Nov 02 10:00:25 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:25 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3" returned: 0 in 0.480s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:25 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.info Nov 02 10:00:25 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:26 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.info" returned: 0 in 0.425s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:26 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:00:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:26 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.info Nov 02 10:00:26 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:26 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.info" returned: 0 in 0.577s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Acquiring lock "cinder-quobyte-a4ffab20-d788-4af7-9f67-6160cb96aec8" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Lock "cinder-quobyte-a4ffab20-d788-4af7-9f67-6160cb96aec8" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] snapshot: 2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3, volume: a4ffab20-d788-4af7-9f67-6160cb96aec8, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a561440-9e8e-47d3-b228-d0a588189a6f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:27 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 Nov 02 10:00:27 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:27 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3" returned: 0 in 0.706s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc897e38-781a-4b75-b3f3-6ea6836460d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1224647-bd6a-425c-8d61-a538a5c1bd1c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:28 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 Nov 02 10:00:28 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:28 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0" returned: 0 in 0.539s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:00:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:00:28 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:00:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:28 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 Nov 02 10:00:28 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bcbc7381-3857-497e-9545-354ec0da55cd tempest-GroupsV320Test-740869589 None] Group tempest-GroupsV320Test-Group-1471880402: creating Nov 02 10:00:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bcbc7381-3857-497e-9545-354ec0da55cd tempest-GroupsV320Test-740869589 None] Group tempest-GroupsV320Test-Group-1471880402: created successfully Nov 02 10:00:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bcbc7381-3857-497e-9545-354ec0da55cd tempest-GroupsV320Test-740869589 None] Create group completed successfully. Nov 02 10:00:35 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] Created reservations ['38dad721-e3ea-4cd4-aed7-4844c0811b3c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:35 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:00:35 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:36 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.457s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:36 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:36 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-66799736-e24e-4f4d-bae1-05d71511ee50 tempest-GroupsV320Test-740869589 None] Delete group completed successfully. Nov 02 10:00:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8" returned: 0 in 10.930s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:39 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0, size 1024.00 MB, duration 10.93 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:00:39 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Converted 1024.00 MB image at 93.68 MB/s Nov 02 10:00:39 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:00:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:39 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 Nov 02 10:00:39 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:39 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8" returned: 0 in 0.627s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Lock "cinder-quobyte-a4ffab20-d788-4af7-9f67-6160cb96aec8" released by "_copy_volume_from_snapshot" :: held 12.969s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Acquiring lock "cinder-quobyte-2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Lock "cinder-quobyte-2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Deleting offline snapshot 2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 of volume cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:00:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] snapshot_file for this snap is: volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:00:40 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f937f7a-1bca-4a44-952d-c907a6995b18]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:40 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 Nov 02 10:00:40 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:40 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3" returned: 0 in 0.818s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc897e38-781a-4b75-b3f3-6ea6836460d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:00:41 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1719bc53-4c88-46cc-98a1-389aaca09c19]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:41 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 Nov 02 10:00:41 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:42 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0" returned: 0 in 1.057s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:42 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 Nov 02 10:00:42 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:42 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3" returned: 0 in 0.716s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:42 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3 Nov 02 10:00:42 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:43 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0.2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3" returned: 0 in 0.401s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Lock "cinder-quobyte-2b7443bf-47ba-4ea8-af2f-4cb4bca2ded3" released by "_delete_snapshot" :: held 3.233s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.924s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:43 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3273092e-2745-41f0-869b-8bfbb31fe458 tempest-GroupsV314Test-126469062 None] Create group from source-group-9e87d5e0-5286-4090-8249-8b079f250ee9 completed successfully. Nov 02 10:00:44 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Acquiring lock "cinder-quobyte-a4ffab20-d788-4af7-9f67-6160cb96aec8" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:44 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Lock "cinder-quobyte-a4ffab20-d788-4af7-9f67-6160cb96aec8" acquired by "delete_volume" :: waited 0.034s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8040931-6703-4175-aea9-d77549db6e96]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:45 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 Nov 02 10:00:45 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Flow 'volume_create_manager' (a9e944a6-23a8-43bc-abf1-93e2aa5d73b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaf4380-b669-43fc-9a74-d666362cc15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaf4380-b669-43fc-9a74-d666362cc15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1820793417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5682fa0d-bb10-4f9d-9f04-3863ab3ce56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99179f54ecc74be9b582929605abcd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:45Z,use_quota=True,user_id='d1b23f1699ca4cf8a21940c17fecf9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d55fa8-773b-4a91-b194-73ac7c62c1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d55fa8-773b-4a91-b194-73ac7c62c1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc3c5c0-9b38-49ab-be39-d08700ade900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc3c5c0-9b38-49ab-be39-d08700ade900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5682fa0d-bb10-4f9d-9f04-3863ab3ce56b', 'volume_name': 'volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c2c0ca-141a-43b8-9b13-26dccba7ef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c2c0ca-141a-43b8-9b13-26dccba7ef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5ff322-7df9-4281-a89c-e60026e68bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:45 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Volume 5682fa0d-bb10-4f9d-9f04-3863ab3ce56b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b', 'volume_size': 1} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1820793417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5682fa0d-bb10-4f9d-9f04-3863ab3ce56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99179f54ecc74be9b582929605abcd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:45Z,use_quota=True,user_id='d1b23f1699ca4cf8a21940c17fecf9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Creating volume 5682fa0d-bb10-4f9d-9f04-3863ab3ce56b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:45 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:45 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b 1073741824 Nov 02 10:00:45 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:45 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8" returned: 0 in 0.615s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:45 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8 Nov 02 10:00:45 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:45 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a4ffab20-d788-4af7-9f67-6160cb96aec8" returned: 0 in 0.371s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Lock "cinder-quobyte-a4ffab20-d788-4af7-9f67-6160cb96aec8" released by "delete_volume" :: held 1.121s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Created reservations ['ad35213f-1d4d-447a-a087-d9da05bb58e1'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:46 devstack cinder-volume[86840]: WARNING cinder.quota [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1947100380 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1947100380, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:00:46 devstack cinder-volume[86840]: WARNING cinder.quota [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1947100380 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1947100380, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Created reservations ['cb0ec0e7-4c7d-49c8-8024-f5d0fe3d87e4', '70ab6cbd-6b7d-4bfb-a876-27aab5be5cbb', '91851369-a14c-41d0-affd-0a0f0c89d8b3', 'ca5432d3-def8-4c53-8a57-8b18b380c16a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:46 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b 1073741824" returned: 0 in 0.901s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:46 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:00:46 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:46 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b Nov 02 10:00:46 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:46 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b" returned: 0 in 0.345s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5ff322-7df9-4281-a89c-e60026e68bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889c738f-e726-4666-9fb0-6c267b4a8713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Volume volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b (5682fa0d-bb10-4f9d-9f04-3863ab3ce56b): created successfully Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889c738f-e726-4666-9fb0-6c267b4a8713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Flow 'volume_create_manager' (a9e944a6-23a8-43bc-abf1-93e2aa5d73b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1a5566ad-1fea-45aa-93aa-2fa04635dffa tempest-VolumesAdminNegativeTest-1557927653 None] Created volume successfully. Nov 02 10:00:47 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.549s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:47 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3883b28d-af37-4828-a0a4-55108205c22a tempest-GroupsV314Test-126469062 None] Delete group completed successfully. Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Acquiring lock "cinder-quobyte-cc897e38-781a-4b75-b3f3-6ea6836460d0" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Lock "cinder-quobyte-cc897e38-781a-4b75-b3f3-6ea6836460d0" acquired by "delete_volume" :: waited 0.056s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c32a55-e722-41a6-ab53-3e1455375710]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:48 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 Nov 02 10:00:48 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Acquiring lock "cinder-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Lock "cinder-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Acquiring lock "cinder-quobyte-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Lock "cinder-quobyte-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b" acquired by "delete_volume" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abcbade-9d03-47f9-a929-5d14372b1b8d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:48 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0" returned: 0 in 0.641s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:49 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0 Nov 02 10:00:49 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:49 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b Nov 02 10:00:49 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:49 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc897e38-781a-4b75-b3f3-6ea6836460d0" returned: 0 in 0.481s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Lock "cinder-quobyte-cc897e38-781a-4b75-b3f3-6ea6836460d0" released by "delete_volume" :: held 1.231s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:49 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Created reservations ['12dc8378-7b37-4e16-8248-5f90440fcf28'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:49 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b" returned: 0 in 0.798s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:49 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Created reservations ['688045e9-f8f1-445a-b3da-3c419de182ed', '109d01bc-0bcc-4d27-ab48-a74b157f27ca', '894cf2a5-70ee-4654-9a1c-170119e9ae5a', 'ca3fde20-4bd5-47dc-90f1-45085bc0fac1'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:49 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b Nov 02 10:00:49 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:50 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:00:50 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:50 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b" returned: 0 in 0.523s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Lock "cinder-quobyte-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b" released by "delete_volume" :: held 1.401s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Created reservations ['8bc3bc67-f7ba-4f34-994e-b3de380628f3', '84c9c15b-54f0-4e2c-8ef9-390eb3e45b40', 'cba554e0-dfdd-4b0b-b5f0-4180db617585', 'b6ed7bb0-b30d-4fb7-b622-49dd34ac3b28'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:50 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:00:50 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:50 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.573s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:50 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f5eadefc-bddc-476a-9a5f-e3dd02143ff2 tempest-GroupsV314Test-126469062 None] Delete group completed successfully. Nov 02 10:00:50 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.459s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:50 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:50 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Deleted volume successfully. Nov 02 10:00:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-59eb30aa-1992-4acd-b9f3-8533ca80955a tempest-VolumesAdminNegativeTest-1557927653 None] Lock "cinder-5682fa0d-bb10-4f9d-9f04-3863ab3ce56b-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:00 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=56,cinder:UPDATE=57,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:00 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=67,cinder:SELECT=50,cinder:INSERT=17,cinder:DELETE=1 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:01:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:20 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:01:20 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Flow 'volume_create_manager' (13964560-cef1-4d45-9988-63b37fe20c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d339bc-90ea-492a-b8f1-bf7c5ded16db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d339bc-90ea-492a-b8f1-bf7c5ded16db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1365118148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425914169b90417f87694ec7ad2ef31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:21Z,use_quota=True,user_id='0dc44512dcc74de0abcec31db7f9b03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611a144f-7e66-460c-b3d4-b76aad6dd4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611a144f-7e66-460c-b3d4-b76aad6dd4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d73a04a-d9b7-4490-a082-c93dd46bbd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d73a04a-d9b7-4490-a082-c93dd46bbd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7', 'volume_name': 'volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e9706c-9ce0-478e-b982-87ac522a4927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e9706c-9ce0-478e-b982-87ac522a4927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc868fb6-81a4-4db1-8d09-012fb6890037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Volume 3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7', 'volume_size': 1} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1365118148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425914169b90417f87694ec7ad2ef31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:21Z,use_quota=True,user_id='0dc44512dcc74de0abcec31db7f9b03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Creating volume 3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:01:21 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:21 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 1073741824 Nov 02 10:01:21 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:21 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.602s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 8 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:01:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:01:22 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 1073741824" returned: 0 in 0.979s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:22 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 Nov 02 10:01:22 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:22 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7" returned: 0 in 0.439s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:01:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc868fb6-81a4-4db1-8d09-012fb6890037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0cb27b-013f-40f8-9147-669633e9071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:22 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Volume volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 (3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7): created successfully Nov 02 10:01:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0cb27b-013f-40f8-9147-669633e9071e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Flow 'volume_create_manager' (13964560-cef1-4d45-9988-63b37fe20c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:22 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e6316ad3-6b72-4793-bf56-370a88a492fe tempest-VolumeQuotasAdminTestJSON-935384445 None] Created volume successfully. Nov 02 10:01:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Acquiring lock "cinder-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "cinder-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Acquiring lock "cinder-quobyte-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "cinder-quobyte-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[558da170-2f24-43f6-9724-e031b85cef26]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:01:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:23 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 Nov 02 10:01:23 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:24 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7" returned: 0 in 0.853s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:24 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7 Nov 02 10:01:24 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:25 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7" returned: 0 in 0.583s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "cinder-quobyte-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7" released by "delete_volume" :: held 1.527s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:25 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Created reservations ['21013146-30b4-440b-a339-8d55dd455def', '9c315e7b-0325-490d-9bb6-f067d1482a42', '02aa9157-0c91-41d2-a02a-685a93b454dc', 'c83b9b17-491d-41db-9890-8eb5c3aa15af'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:01:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:25 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:01:25 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:26 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.414s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:26 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:01:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Deleted volume successfully. Nov 02 10:01:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0813a77a-1423-49f9-a720-8aedef19f34c tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "cinder-3b0aecd3-f1ba-4ba9-ba5b-b73aae5f8dc7-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Flow 'volume_create_manager' (61f82ceb-2f5b-48d0-905b-1d06c74be46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77795644-e4ef-41cd-b2fd-4514910c528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77795644-e4ef-41cd-b2fd-4514910c528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-108380792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfc60ba-2842-4949-a966-3e644e04690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425914169b90417f87694ec7ad2ef31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:27Z,use_quota=True,user_id='0dc44512dcc74de0abcec31db7f9b03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d4e96e-d395-4402-9c5d-e5a1ba2af2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d4e96e-d395-4402-9c5d-e5a1ba2af2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eebc23-78b1-4828-86a8-6dd0f4bb7de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eebc23-78b1-4828-86a8-6dd0f4bb7de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bfc60ba-2842-4949-a966-3e644e04690a', 'volume_name': 'volume-9bfc60ba-2842-4949-a966-3e644e04690a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a1b2eb-81c1-4b69-934f-085e37d341ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a1b2eb-81c1-4b69-934f-085e37d341ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbad2071-aa94-48db-8c6f-76f9d4aff80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:27 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Volume 9bfc60ba-2842-4949-a966-3e644e04690a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bfc60ba-2842-4949-a966-3e644e04690a', 'volume_size': 1} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-108380792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfc60ba-2842-4949-a966-3e644e04690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425914169b90417f87694ec7ad2ef31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:27Z,use_quota=True,user_id='0dc44512dcc74de0abcec31db7f9b03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Creating volume 9bfc60ba-2842-4949-a966-3e644e04690a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:01:27 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:01:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:27 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a 1073741824 Nov 02 10:01:27 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:28 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a 1073741824" returned: 0 in 0.676s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:28 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a Nov 02 10:01:28 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:28 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a" returned: 0 in 0.397s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:01:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbad2071-aa94-48db-8c6f-76f9d4aff80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bfc60ba-2842-4949-a966-3e644e04690a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff11d5e-aed4-4c21-bff6-43814d4a17a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:28 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Volume volume-9bfc60ba-2842-4949-a966-3e644e04690a (9bfc60ba-2842-4949-a966-3e644e04690a): created successfully Nov 02 10:01:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff11d5e-aed4-4c21-bff6-43814d4a17a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Flow 'volume_create_manager' (61f82ceb-2f5b-48d0-905b-1d06c74be46e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4991b2d3-3fe8-4c2c-9c3a-618010a50aa0 tempest-VolumeQuotasAdminTestJSON-935384445 None] Created volume successfully. Nov 02 10:01:30 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8a6d2e17-c0ce-4615-8e34-3f9ae8253ac7 tempest-VolumeQuotasAdminTestJSON-963224764 None] Transfer volume completed successfully. Nov 02 10:01:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Acquiring lock "cinder-9bfc60ba-2842-4949-a966-3e644e04690a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Lock "cinder-9bfc60ba-2842-4949-a966-3e644e04690a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Acquiring lock "cinder-quobyte-9bfc60ba-2842-4949-a966-3e644e04690a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Lock "cinder-quobyte-9bfc60ba-2842-4949-a966-3e644e04690a" acquired by "delete_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:31 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b93ccf4-3d72-4b0b-b07a-75223f1632b5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:01:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:31 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a Nov 02 10:01:31 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:32 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a" returned: 0 in 0.586s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:32 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a Nov 02 10:01:32 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:32 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bfc60ba-2842-4949-a966-3e644e04690a" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Lock "cinder-quobyte-9bfc60ba-2842-4949-a966-3e644e04690a" released by "delete_volume" :: held 1.051s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Created reservations ['90dffcfe-584c-425b-9e74-84e993e3ea69', '4242df16-598d-42e6-a352-15c04a53f6a1', '6d6cf5c4-ae84-435d-9626-59ddc341ee22', '19c55ec8-9885-4a95-96e4-9d60cd2ac74a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:32 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:01:32 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:33 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.384s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:33 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:01:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Deleted volume successfully. Nov 02 10:01:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-991a19f9-9b72-489b-97c2-1ba522d2ee74 tempest-VolumeQuotasAdminTestJSON-1164124186 None] Lock "cinder-9bfc60ba-2842-4949-a966-3e644e04690a-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:42 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:43 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=22,cinder:SELECT=16,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:01:43 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:01:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Flow 'volume_create_manager' (f689f1bb-602d-49d9-a4ec-83fa5f2732d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db5c9dc-ba1b-424e-bf19-5febd96245bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db5c9dc-ba1b-424e-bf19-5febd96245bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-322107949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e994dd-7107-4075-abc7-ba2f512d7413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5ffbf383794836875cad980be02a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:44Z,use_quota=True,user_id='0597500e57374d4391fa5a7b6a7532d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d31f4c31-104b-4a7e-b4e6-65e4f38e2752),volume_type_id=d31f4c31-104b-4a7e-b4e6-65e4f38e2752)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df38031d-8806-42f6-a35e-951aca883670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df38031d-8806-42f6-a35e-951aca883670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae9210b-ee9f-48a5-a0c7-737173511bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae9210b-ee9f-48a5-a0c7-737173511bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e994dd-7107-4075-abc7-ba2f512d7413', 'volume_name': 'volume-11e994dd-7107-4075-abc7-ba2f512d7413', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3671130-2095-4b57-8278-5b194ed05e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3671130-2095-4b57-8278-5b194ed05e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3132578-0437-4c68-b845-424aba3dfeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:44 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Volume 11e994dd-7107-4075-abc7-ba2f512d7413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e994dd-7107-4075-abc7-ba2f512d7413', 'volume_size': 1} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-322107949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e994dd-7107-4075-abc7-ba2f512d7413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5ffbf383794836875cad980be02a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:44Z,use_quota=True,user_id='0597500e57374d4391fa5a7b6a7532d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d31f4c31-104b-4a7e-b4e6-65e4f38e2752),volume_type_id=d31f4c31-104b-4a7e-b4e6-65e4f38e2752)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Creating volume 11e994dd-7107-4075-abc7-ba2f512d7413 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:01:44 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:44 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413 1073741824 Nov 02 10:01:44 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:44 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413 1073741824" returned: 0 in 0.756s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:44 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413 Nov 02 10:01:44 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:45 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413" returned: 0 in 0.349s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:01:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3132578-0437-4c68-b845-424aba3dfeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e994dd-7107-4075-abc7-ba2f512d7413', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82616082-303e-4208-bca4-66bcea8f1a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:45 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Volume volume-11e994dd-7107-4075-abc7-ba2f512d7413 (11e994dd-7107-4075-abc7-ba2f512d7413): created successfully Nov 02 10:01:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82616082-303e-4208-bca4-66bcea8f1a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Flow 'volume_create_manager' (f689f1bb-602d-49d9-a4ec-83fa5f2732d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8ae61457-c749-4176-8bea-259aa41565c2 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Created volume successfully. Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Flow 'volume_create_manager' (374fd76a-de41-4300-a065-950f5aec0c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e914ce3b-cfcc-40d1-ba55-7c33a5cf2407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e914ce3b-cfcc-40d1-ba55-7c33a5cf2407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2054277643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed0bdd6-f4a5-4547-a18f-fac528ab01b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35727c48a4374ef79f5dc04a4c91fb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:46Z,use_quota=True,user_id='2c9816f71cda41f398bacd238191c5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f0f3f-6f2c-470b-922e-10caea647167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f0f3f-6f2c-470b-922e-10caea647167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e5fd49-e02c-452e-b47b-b421eb5d05b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e5fd49-e02c-452e-b47b-b421eb5d05b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed0bdd6-f4a5-4547-a18f-fac528ab01b5', 'volume_name': 'volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14c63d2-d3b2-4542-a153-edf6a6579d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14c63d2-d3b2-4542-a153-edf6a6579d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa60ea6-303d-4e6a-8ec7-810216642a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Volume 0ed0bdd6-f4a5-4547-a18f-fac528ab01b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5', 'volume_size': 1} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2054277643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed0bdd6-f4a5-4547-a18f-fac528ab01b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35727c48a4374ef79f5dc04a4c91fb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:46Z,use_quota=True,user_id='2c9816f71cda41f398bacd238191c5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Creating volume 0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:01:46 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:46 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 1073741824 Nov 02 10:01:46 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Flow 'volume_create_manager' (992e0d65-1f96-4070-8007-5c7ae6ce4231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7460a-8464-4ebd-b531-32f214274bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7460a-8464-4ebd-b531-32f214274bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-123664721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cc9958-1aed-430f-adc3-38e72ab3d428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a709938cf8e443bc81a299d10712cd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:47Z,use_quota=True,user_id='1a7a50fb815a43fd8d69caa4230eb528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d1ca2d-63da-433d-b125-e30733046911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d1ca2d-63da-433d-b125-e30733046911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0decf9ca-c022-4877-b4d6-fcacda29a595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0decf9ca-c022-4877-b4d6-fcacda29a595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33cc9958-1aed-430f-adc3-38e72ab3d428', 'volume_name': 'volume-33cc9958-1aed-430f-adc3-38e72ab3d428', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efeb6f26-1fe3-4aea-85c7-a62555ceb7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efeb6f26-1fe3-4aea-85c7-a62555ceb7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518b770b-5c97-4f5a-b072-5551a8d1c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Volume 33cc9958-1aed-430f-adc3-38e72ab3d428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33cc9958-1aed-430f-adc3-38e72ab3d428', 'volume_size': 1} Nov 02 10:01:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-418f617d-15d1-4718-a2da-7aeb3b18838d tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-418f617d-15d1-4718-a2da-7aeb3b18838d tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-418f617d-15d1-4718-a2da-7aeb3b18838d tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-418f617d-15d1-4718-a2da-7aeb3b18838d tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-418f617d-15d1-4718-a2da-7aeb3b18838d tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-418f617d-15d1-4718-a2da-7aeb3b18838d tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:47 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:01:47 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:47 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 1073741824" returned: 0 in 0.762s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:47 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 Nov 02 10:01:47 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:47 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-418f617d-15d1-4718-a2da-7aeb3b18838d tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.359s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-418f617d-15d1-4718-a2da-7aeb3b18838d tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:01:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-418f617d-15d1-4718-a2da-7aeb3b18838d tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Retype volume completed successfully. Nov 02 10:01:47 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5" returned: 0 in 0.331s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-123664721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cc9958-1aed-430f-adc3-38e72ab3d428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a709938cf8e443bc81a299d10712cd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:01:47Z,use_quota=True,user_id='1a7a50fb815a43fd8d69caa4230eb528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Creating volume 33cc9958-1aed-430f-adc3-38e72ab3d428 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:01:47 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa60ea6-303d-4e6a-8ec7-810216642a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:47 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428 1073741824 Nov 02 10:01:47 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37741df-8e68-4acc-bd99-c9c9f72aed22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Volume volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 (0ed0bdd6-f4a5-4547-a18f-fac528ab01b5): created successfully Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37741df-8e68-4acc-bd99-c9c9f72aed22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Flow 'volume_create_manager' (374fd76a-de41-4300-a065-950f5aec0c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ae82c3bc-fe97-4271-b87c-2e7da8d5694b tempest-ServerActionsTestOtherA-1016928452 None] Created volume successfully. Nov 02 10:01:48 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428 1073741824" returned: 0 in 0.680s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:48 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428 Nov 02 10:01:48 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Acquiring lock "cinder-11e994dd-7107-4075-abc7-ba2f512d7413-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "cinder-11e994dd-7107-4075-abc7-ba2f512d7413-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Acquiring lock "cinder-quobyte-11e994dd-7107-4075-abc7-ba2f512d7413" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "cinder-quobyte-11e994dd-7107-4075-abc7-ba2f512d7413" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f039d2-3379-468f-b1dd-d6836b073780]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:48 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428" returned: 0 in 0.501s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:01:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518b770b-5c97-4f5a-b072-5551a8d1c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33cc9958-1aed-430f-adc3-38e72ab3d428', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7c7b65-0e85-4c9e-9457-4d8bb6c3b804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:01:49 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413 Nov 02 10:01:49 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Volume volume-33cc9958-1aed-430f-adc3-38e72ab3d428 (33cc9958-1aed-430f-adc3-38e72ab3d428): created successfully Nov 02 10:01:49 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7c7b65-0e85-4c9e-9457-4d8bb6c3b804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:01:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Flow 'volume_create_manager' (992e0d65-1f96-4070-8007-5c7ae6ce4231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:01:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e18c3010-4814-4a0e-999d-5ec1f55ecf54 tempest-VolumesServicesTestJSON-66692856 None] Created volume successfully. Nov 02 10:01:49 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413" returned: 0 in 0.532s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:49 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413 Nov 02 10:01:49 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:49 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-11e994dd-7107-4075-abc7-ba2f512d7413" returned: 0 in 0.375s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "cinder-quobyte-11e994dd-7107-4075-abc7-ba2f512d7413" released by "delete_volume" :: held 1.011s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:49 devstack cinder-volume[86840]: WARNING cinder.quota [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:01:49 devstack cinder-volume[86840]: WARNING cinder.quota [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:01:49 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Created reservations ['4f6e1302-3488-4f93-b0f0-b5eca759734b', '3d18b0c4-d21c-4368-8a6d-f84aaf3864ea', '3827ba7a-02e3-4ed8-9d64-b07c52a76ccd', '7804615a-ef75-404a-b583-ac31a94c38da'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Acquiring lock "cinder-33cc9958-1aed-430f-adc3-38e72ab3d428-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Lock "cinder-33cc9958-1aed-430f-adc3-38e72ab3d428-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:50 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:01:50 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Acquiring lock "cinder-quobyte-33cc9958-1aed-430f-adc3-38e72ab3d428" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Lock "cinder-quobyte-33cc9958-1aed-430f-adc3-38e72ab3d428" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8aa240-6953-4caf-8abb-29db888ce02b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:50 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428 Nov 02 10:01:50 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:50 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.465s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:01:50 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Deleted volume successfully. Nov 02 10:01:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-04ff13c4-891b-4036-8dda-02b84f9b7965 tempest-VolumeRetypeWithoutMigrationTest-1556714534 None] Lock "cinder-11e994dd-7107-4075-abc7-ba2f512d7413-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:50 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428" returned: 0 in 0.742s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:51 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428 Nov 02 10:01:51 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:51 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-33cc9958-1aed-430f-adc3-38e72ab3d428" returned: 0 in 0.549s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Lock "cinder-quobyte-33cc9958-1aed-430f-adc3-38e72ab3d428" released by "delete_volume" :: held 1.378s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Created reservations ['45d52c87-1d53-48be-a63f-df7c129a591e', '19e0562b-4e7f-48cd-b26a-2a28d0594afe', 'fc03b571-5fe5-4793-b577-debfdb8702c7', 'efd297ef-690a-4f0c-ab1a-201c406c9261'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:01:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:01:51 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:01:51 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:01:52 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Nov 02 10:01:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.370s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:01:52 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:01:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Deleted volume successfully. Nov 02 10:01:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-776bdb07-68da-4a6c-a657-48ac465323ca tempest-VolumesServicesTestJSON-66692856 None] Lock "cinder-33cc9958-1aed-430f-adc3-38e72ab3d428-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:01 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=28,cinder:UPDATE=31,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:02 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=29,cinder:SELECT=19,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Flow 'volume_create_manager' (81c62449-2b2d-4c0d-9641-44e4731b3ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac20ce68-48e8-42c0-9028-a471e885d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac20ce68-48e8-42c0-9028-a471e885d57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51391968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e416df-544a-41d9-a172-a08191758b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e360cfae77c4c55abd37a5e1b526f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:04Z,use_quota=True,user_id='9d25c10daac94e6e98cfa482fc60ad0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5753a490-07ff-4465-bdc7-457f5e6f6fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5753a490-07ff-4465-bdc7-457f5e6f6fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2461192b-3db3-45bf-a825-13738c226ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2461192b-3db3-45bf-a825-13738c226ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e416df-544a-41d9-a172-a08191758b41', 'volume_name': 'volume-20e416df-544a-41d9-a172-a08191758b41', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3aeae10-9864-4692-be2e-eff859295201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3aeae10-9864-4692-be2e-eff859295201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88d5f2e-4399-4642-b9f7-016a062bbfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:04 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Volume 20e416df-544a-41d9-a172-a08191758b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e416df-544a-41d9-a172-a08191758b41', 'volume_size': 1} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-51391968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e416df-544a-41d9-a172-a08191758b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e360cfae77c4c55abd37a5e1b526f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:04Z,use_quota=True,user_id='9d25c10daac94e6e98cfa482fc60ad0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Creating volume 20e416df-544a-41d9-a172-a08191758b41 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:04 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:02:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:04 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41 1073741824 Nov 02 10:02:04 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:06 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41 1073741824" returned: 0 in 1.588s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:06 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41 Nov 02 10:02:06 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:06 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41" returned: 0 in 0.523s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88d5f2e-4399-4642-b9f7-016a062bbfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e416df-544a-41d9-a172-a08191758b41', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fe7588-8f19-4fe3-aaf6-d71ffed07be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:06 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Volume volume-20e416df-544a-41d9-a172-a08191758b41 (20e416df-544a-41d9-a172-a08191758b41): created successfully Nov 02 10:02:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1fe7588-8f19-4fe3-aaf6-d71ffed07be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Flow 'volume_create_manager' (81c62449-2b2d-4c0d-9641-44e4731b3ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2c8f5346-6f67-4a98-b3a1-024df4ce14f7 tempest-DeleteServersTestJSON-1577864216 None] Created volume successfully. Nov 02 10:02:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-ca0e3529-9989-42e6-b406-6938a5bfa9bb req-dbfc70f7-64f8-4e2e-a709-8053f94f9e31 tempest-DeleteServersTestJSON-1577864216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-ca0e3529-9989-42e6-b406-6938a5bfa9bb req-dbfc70f7-64f8-4e2e-a709-8053f94f9e31 tempest-DeleteServersTestJSON-1577864216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-ca0e3529-9989-42e6-b406-6938a5bfa9bb req-dbfc70f7-64f8-4e2e-a709-8053f94f9e31 tempest-DeleteServersTestJSON-1577864216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-ca0e3529-9989-42e6-b406-6938a5bfa9bb req-dbfc70f7-64f8-4e2e-a709-8053f94f9e31 tempest-DeleteServersTestJSON-1577864216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-20e416df-544a-41d9-a172-a08191758b41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b329cd8-a88b-498c-91cd-a1c67b3c0686', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:02:11 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-ca0e3529-9989-42e6-b406-6938a5bfa9bb req-dbfc70f7-64f8-4e2e-a709-8053f94f9e31 tempest-DeleteServersTestJSON-1577864216 None] attachment_update completed successfully. Nov 02 10:02:16 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-415fb7c1-2005-49ab-b9a0-4f1b1626e486 req-ba13b9bf-e623-430d-8aee-709afb2d400b tempest-DeleteServersTestJSON-1577864216 None] Terminate volume connection completed successfully. Nov 02 10:02:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-415fb7c1-2005-49ab-b9a0-4f1b1626e486 req-ba13b9bf-e623-430d-8aee-709afb2d400b tempest-DeleteServersTestJSON-1577864216 None] Deleting attachment 1b329cd8-a88b-498c-91cd-a1c67b3c0686. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:02:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Acquiring lock "cinder-20e416df-544a-41d9-a172-a08191758b41-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Lock "cinder-20e416df-544a-41d9-a172-a08191758b41-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Acquiring lock "cinder-quobyte-20e416df-544a-41d9-a172-a08191758b41" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Lock "cinder-quobyte-20e416df-544a-41d9-a172-a08191758b41" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:18 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[091dfd8b-f03a-4cee-bd00-882c421dfd34]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:18 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41 Nov 02 10:02:18 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:18 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41" returned: 0 in 0.583s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:18 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41 Nov 02 10:02:18 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:19 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-20e416df-544a-41d9-a172-a08191758b41" returned: 0 in 0.368s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Lock "cinder-quobyte-20e416df-544a-41d9-a172-a08191758b41" released by "delete_volume" :: held 1.028s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:19 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Created reservations ['a2db17c5-f5e9-4e1b-bd95-952309557f46', '378bbfe9-64a8-46be-b71f-6ec1de4f6dc6', 'd0deea4f-6679-4762-84ea-abba43e6ed9c', 'e721be74-13dc-4899-a306-e3f44b0f97c7'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:19 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:02:19 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:20 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.445s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:20 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Deleted volume successfully. Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d9dfa807-4d1f-42b2-9bec-bd605b075e27 tempest-DeleteServersTestJSON-1577864216 None] Lock "cinder-20e416df-544a-41d9-a172-a08191758b41-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:20 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:02:20 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:21 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.391s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:02:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 8 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:02:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Flow 'volume_create_manager' (a6f3d1a9-32db-4e6b-8ac1-7db77686e665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa2d8d4-20e9-4474-8720-8a8edc30f6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa2d8d4-20e9-4474-8720-8a8edc30f6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-112836604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2691695e-d88c-4286-a3ee-97a141e2398a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d316499ccff40778da7076152f0f3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:27Z,use_quota=True,user_id='b1472eebc84542629c735baa3dce0b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540f4d6e-6251-4659-ad00-93791d4cbec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540f4d6e-6251-4659-ad00-93791d4cbec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056528de-5b9d-4c25-a1f9-0e1edc41ea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056528de-5b9d-4c25-a1f9-0e1edc41ea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2691695e-d88c-4286-a3ee-97a141e2398a', 'volume_name': 'volume-2691695e-d88c-4286-a3ee-97a141e2398a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184698bf-f7f4-40c3-aa07-a35e9aca8a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184698bf-f7f4-40c3-aa07-a35e9aca8a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b33d40-ebbc-4b51-804b-c600e4b0c4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:27 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Volume 2691695e-d88c-4286-a3ee-97a141e2398a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2691695e-d88c-4286-a3ee-97a141e2398a', 'volume_size': 1} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-112836604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2691695e-d88c-4286-a3ee-97a141e2398a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d316499ccff40778da7076152f0f3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:27Z,use_quota=True,user_id='b1472eebc84542629c735baa3dce0b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Creating volume 2691695e-d88c-4286-a3ee-97a141e2398a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:27 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:02:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:27 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a 1073741824 Nov 02 10:02:27 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:28 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a 1073741824" returned: 0 in 0.766s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:28 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a Nov 02 10:02:28 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:28 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a" returned: 0 in 0.295s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b33d40-ebbc-4b51-804b-c600e4b0c4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2691695e-d88c-4286-a3ee-97a141e2398a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a89b2f8-90f4-4fa7-8a5a-9034534240ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:28 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Volume volume-2691695e-d88c-4286-a3ee-97a141e2398a (2691695e-d88c-4286-a3ee-97a141e2398a): created successfully Nov 02 10:02:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a89b2f8-90f4-4fa7-8a5a-9034534240ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Flow 'volume_create_manager' (a6f3d1a9-32db-4e6b-8ac1-7db77686e665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0e72159b-94fc-4a5f-ba53-558ba70d1d91 tempest-AbsoluteLimitsTests-1448580403 None] Created volume successfully. Nov 02 10:02:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Acquiring lock "cinder-2691695e-d88c-4286-a3ee-97a141e2398a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Lock "cinder-2691695e-d88c-4286-a3ee-97a141e2398a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Acquiring lock "cinder-quobyte-2691695e-d88c-4286-a3ee-97a141e2398a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:02:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Lock "cinder-quobyte-2691695e-d88c-4286-a3ee-97a141e2398a" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:02:30 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b22a392-bb40-4e23-84ac-8da5b1eb8936]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:30 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a Nov 02 10:02:30 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:30 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a" returned: 0 in 0.472s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:30 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a Nov 02 10:02:30 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:31 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2691695e-d88c-4286-a3ee-97a141e2398a" returned: 0 in 0.463s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Lock "cinder-quobyte-2691695e-d88c-4286-a3ee-97a141e2398a" released by "delete_volume" :: held 0.999s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Created reservations ['1be1072f-08b6-4aec-b3e6-104e629c42a0', '95164ee7-e599-4cf8-afac-599c81355057', '924e10eb-5ee5-494c-ab93-05fa312aeeb4', '2cda101a-9b4f-499a-afcf-4f706eb80a53'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:31 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:02:31 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:31 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.302s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:02:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Deleted volume successfully. Nov 02 10:02:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b0c07c99-18c8-4576-b5ed-08b9e0c486c0 tempest-AbsoluteLimitsTests-1448580403 None] Lock "cinder-2691695e-d88c-4286-a3ee-97a141e2398a-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:02:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-24dd7dee-c5b0-4760-84c4-2ef2eeb72cef req-991119ba-3380-4016-8147-317980f8a6d0 tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-24dd7dee-c5b0-4760-84c4-2ef2eeb72cef req-991119ba-3380-4016-8147-317980f8a6d0 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-24dd7dee-c5b0-4760-84c4-2ef2eeb72cef req-991119ba-3380-4016-8147-317980f8a6d0 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-24dd7dee-c5b0-4760-84c4-2ef2eeb72cef req-991119ba-3380-4016-8147-317980f8a6d0 tempest-ServerActionsTestOtherA-1016928452 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c27f9281-996c-4b22-a41b-c6f32829f92e', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:02:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-24dd7dee-c5b0-4760-84c4-2ef2eeb72cef req-991119ba-3380-4016-8147-317980f8a6d0 tempest-ServerActionsTestOtherA-1016928452 None] attachment_update completed successfully. Nov 02 10:02:43 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=27,cinder:SELECT=33,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:43 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:02:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-411dc991-2dfa-4af2-8d44-07c994224579 req-b3149fcc-2460-43b2-a073-123d2c263f34 tempest-ServerActionsTestOtherA-1016928452 None] Terminate volume connection completed successfully. Nov 02 10:02:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-411dc991-2dfa-4af2-8d44-07c994224579 req-b3149fcc-2460-43b2-a073-123d2c263f34 tempest-ServerActionsTestOtherA-1016928452 None] Deleting attachment c27f9281-996c-4b22-a41b-c6f32829f92e. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:02:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-411dc991-2dfa-4af2-8d44-07c994224579 req-e1663584-eb11-4a95-ab47-b3359515f584 tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-411dc991-2dfa-4af2-8d44-07c994224579 req-e1663584-eb11-4a95-ab47-b3359515f584 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-411dc991-2dfa-4af2-8d44-07c994224579 req-e1663584-eb11-4a95-ab47-b3359515f584 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-411dc991-2dfa-4af2-8d44-07c994224579 req-e1663584-eb11-4a95-ab47-b3359515f584 tempest-ServerActionsTestOtherA-1016928452 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ef72af0-5810-43f4-b95f-8b174a54122f', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:02:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-411dc991-2dfa-4af2-8d44-07c994224579 req-e1663584-eb11-4a95-ab47-b3359515f584 tempest-ServerActionsTestOtherA-1016928452 None] attachment_update completed successfully. Nov 02 10:02:52 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:02:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Flow 'volume_create_manager' (503920bf-62b6-42fb-8bc8-8968285ef193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:02:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67e4602-8821-4a51-be21-db77686b89e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67e4602-8821-4a51-be21-db77686b89e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1562574702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1124f0-ba83-4fb7-9108-377d24298512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e567c171c04472db312eed769e779e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:52Z,use_quota=True,user_id='d91f90181cac46ea8067bf391da5275d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399985f8-4972-417f-8521-eb4ed55b36f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399985f8-4972-417f-8521-eb4ed55b36f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a43044-8913-442d-8cf8-4cbea2d698e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:52 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:02:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a43044-8913-442d-8cf8-4cbea2d698e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca1124f0-ba83-4fb7-9108-377d24298512', 'volume_name': 'volume-ca1124f0-ba83-4fb7-9108-377d24298512', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d7c1b-bc40-4757-bc84-9786c1d86264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447d7c1b-bc40-4757-bc84-9786c1d86264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:02:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd33e09a-7b22-41e7-814c-dd68618bc8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:02:55 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Volume ca1124f0-ba83-4fb7-9108-377d24298512: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca1124f0-ba83-4fb7-9108-377d24298512', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:02:55 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Trying to clone ca1124f0-ba83-4fb7-9108-377d24298512 from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:02:56 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:02:56 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:02:56 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f879f69-9657-4328-90b7-d58341a09f86]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:56 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD Nov 02 10:02:56 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:57 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 is fetched for user d91f90181cac46ea8067bf391da5275d. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c41d7d-7a0e-4e91-9a8f-52de9c8e7dc8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:57 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD Nov 02 10:02:57 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:57 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1562574702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1124f0-ba83-4fb7-9108-377d24298512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e567c171c04472db312eed769e779e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:52Z,use_quota=True,user_id='d91f90181cac46ea8067bf391da5275d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Creating volume ca1124f0-ba83-4fb7-9108-377d24298512 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:02:57 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:02:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:57 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 1073741824 Nov 02 10:02:57 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:58 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 1073741824" returned: 0 in 0.708s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:58 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 Nov 02 10:02:58 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:59 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512" returned: 0 in 0.488s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:02:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:02:59 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Attempting download of 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume ca1124f0-ba83-4fb7-9108-377d24298512. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:02:59 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6309a367-de29-404c-b1cc-d472bded35f7]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:02:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_rfpmpm68 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:02:59 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_rfpmpm68 Nov 02 10:02:59 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:02:59 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Nov 02 10:02:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_rfpmpm68" returned: 0 in 0.533s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:02:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_rfpmpm68 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:00 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_rfpmpm68 Nov 02 10:03:00 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:00 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_rfpmpm68" returned: 1 in 0.505s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_rfpmpm68' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:03:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[40050ad0-16c0-4abf-abbb-44244db6c129]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:00 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD Nov 02 10:03:00 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:01 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD" returned: 0 in 0.967s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:01 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 was qcow2, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:03:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:01 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 Nov 02 10:03:01 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:06 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512" returned: 0 in 5.464s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:06 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_ljh0d1bndevstack@QuobyteHD, size 112.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:03:06 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Converted 112.00 MB image at 20.49 MB/s Nov 02 10:03:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:06 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 1G Nov 02 10:03:06 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:07 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 1G" returned: 0 in 0.814s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:07 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Downloaded image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume ca1124f0-ba83-4fb7-9108-377d24298512 successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:03:07 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 for user d91f90181cac46ea8067bf391da5275d is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:03:07 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Marking volume ca1124f0-ba83-4fb7-9108-377d24298512 as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:03:07 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Copying metadata from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 to ca1124f0-ba83-4fb7-9108-377d24298512. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:03:07 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Creating volume glance metadata for volume ca1124f0-ba83-4fb7-9108-377d24298512 backed by image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:03:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd33e09a-7b22-41e7-814c-dd68618bc8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1124f0-ba83-4fb7-9108-377d24298512', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383919f6-5248-4267-a256-0b154ba8ff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Volume volume-ca1124f0-ba83-4fb7-9108-377d24298512 (ca1124f0-ba83-4fb7-9108-377d24298512): created successfully Nov 02 10:03:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383919f6-5248-4267-a256-0b154ba8ff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Flow 'volume_create_manager' (503920bf-62b6-42fb-8bc8-8968285ef193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e8a7e9d9-897e-49fb-9c2e-b1010ae67fa1 tempest-VolumesExtendTest-1913797569 None] Created volume successfully. Nov 02 10:03:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8a4420d4-93c5-401b-b54e-a736db2aadcb tempest-VolumesExtendTest-1913797569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8a4420d4-93c5-401b-b54e-a736db2aadcb tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[985a2bbe-48a5-4d7c-9048-f5ea55e8c072]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a4420d4-93c5-401b-b54e-a736db2aadcb tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:09 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 Nov 02 10:03:09 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:09 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a4420d4-93c5-401b-b54e-a736db2aadcb tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512" returned: 0 in 0.989s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a4420d4-93c5-401b-b54e-a736db2aadcb tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 2G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a4420d4-93c5-401b-b54e-a736db2aadcb tempest-VolumesExtendTest-1913797569 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 2G" returned: 0 in 0.175s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8a4420d4-93c5-401b-b54e-a736db2aadcb tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.245s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8a4420d4-93c5-401b-b54e-a736db2aadcb tempest-VolumesExtendTest-1913797569 None] Extend volume completed successfully. Nov 02 10:03:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "cinder-ca1124f0-ba83-4fb7-9108-377d24298512-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-ca1124f0-ba83-4fb7-9108-377d24298512-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "cinder-quobyte-ca1124f0-ba83-4fb7-9108-377d24298512" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-quobyte-ca1124f0-ba83-4fb7-9108-377d24298512" acquired by "delete_volume" :: waited 0.040s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:12 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[231705fa-db22-4cfd-a32c-a67154cdbfb4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:12 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 Nov 02 10:03:12 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:13 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512" returned: 0 in 0.687s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:13 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512 Nov 02 10:03:13 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:14 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ca1124f0-ba83-4fb7-9108-377d24298512" returned: 0 in 0.786s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-quobyte-ca1124f0-ba83-4fb7-9108-377d24298512" released by "delete_volume" :: held 1.566s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:14 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Created reservations ['c582e0b0-609e-4ada-b863-08211ac5d426', 'a95a6c5c-00c4-490e-bb52-d33c63f6a9ac', '936bf66d-b577-448b-9a14-a96bd55be571', 'd506812c-a08b-4f0d-91d0-ab301048956a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:14 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:03:14 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:15 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.829s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:15 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Deleted volume successfully. Nov 02 10:03:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ce775a3-015b-427e-9c57-bcaf65a3fcf3 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-ca1124f0-ba83-4fb7-9108-377d24298512-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Flow 'volume_create_manager' (145534bf-feb8-49bf-8b15-acfacfe121ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec22fdb-8043-45a8-99b4-80659bd21f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec22fdb-8043-45a8-99b4-80659bd21f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-824771670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f81a750-0b29-4688-876c-338cc9d66867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e567c171c04472db312eed769e779e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:16Z,use_quota=True,user_id='d91f90181cac46ea8067bf391da5275d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b32b4e-fe6b-42af-964f-3124492c0d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b32b4e-fe6b-42af-964f-3124492c0d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b63f74-4ba1-4f52-bfea-cc992ff146d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b63f74-4ba1-4f52-bfea-cc992ff146d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f81a750-0b29-4688-876c-338cc9d66867', 'volume_name': 'volume-8f81a750-0b29-4688-876c-338cc9d66867', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f7ec91-c0a9-4f47-b3c7-fca98aa91fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f7ec91-c0a9-4f47-b3c7-fca98aa91fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aadb3d-5390-406f-ba6a-c073c6af3d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:16 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Volume 8f81a750-0b29-4688-876c-338cc9d66867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f81a750-0b29-4688-876c-338cc9d66867', 'volume_size': 1} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-824771670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f81a750-0b29-4688-876c-338cc9d66867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e567c171c04472db312eed769e779e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:16Z,use_quota=True,user_id='d91f90181cac46ea8067bf391da5275d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Creating volume 8f81a750-0b29-4688-876c-338cc9d66867 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:16 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:03:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:16 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 1073741824 Nov 02 10:03:16 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:17 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 1073741824" returned: 0 in 1.173s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:18 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 Nov 02 10:03:18 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:18 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867" returned: 0 in 0.787s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75aadb3d-5390-406f-ba6a-c073c6af3d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f81a750-0b29-4688-876c-338cc9d66867', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd8930b-9225-4a2c-86fd-baf871fff7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:19 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Volume volume-8f81a750-0b29-4688-876c-338cc9d66867 (8f81a750-0b29-4688-876c-338cc9d66867): created successfully Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd8930b-9225-4a2c-86fd-baf871fff7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Flow 'volume_create_manager' (145534bf-feb8-49bf-8b15-acfacfe121ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cff6c0ea-e578-4488-ae9d-9bde63de2ab3 tempest-VolumesExtendTest-1913797569 None] Created volume successfully. Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Flow 'volume_create_manager' (608414df-0843-4bba-b546-397f9b473959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b6dc92-fc7e-4093-8f17-ce0a528670b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b6dc92-fc7e-4093-8f17-ce0a528670b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-711582428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dff2462-dfc6-4ef7-b239-de9df2172431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd2cc43b2094134ba1280b06ef1b367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:19Z,use_quota=True,user_id='183465bccf964c25b61e1b791e77341a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4914b698-21c0-4b36-83bb-93324083ad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4914b698-21c0-4b36-83bb-93324083ad96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e60e875-e8f4-45db-ac42-081b5380e68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e60e875-e8f4-45db-ac42-081b5380e68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dff2462-dfc6-4ef7-b239-de9df2172431', 'volume_name': 'volume-5dff2462-dfc6-4ef7-b239-de9df2172431', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e911a5-ade1-4b56-b39d-3ff41ac263c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e911a5-ade1-4b56-b39d-3ff41ac263c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adca1f3-e930-4444-91b9-44eb3b184f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:19 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Volume 5dff2462-dfc6-4ef7-b239-de9df2172431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dff2462-dfc6-4ef7-b239-de9df2172431', 'volume_size': 1} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-711582428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dff2462-dfc6-4ef7-b239-de9df2172431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd2cc43b2094134ba1280b06ef1b367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:19Z,use_quota=True,user_id='183465bccf964c25b61e1b791e77341a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Creating volume 5dff2462-dfc6-4ef7-b239-de9df2172431 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:19 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:03:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:19 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431 1073741824 Nov 02 10:03:19 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:20 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431 1073741824" returned: 0 in 1.265s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:20 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:03:20 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:20 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431 Nov 02 10:03:20 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:21 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431" returned: 0 in 0.376s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.657s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adca1f3-e930-4444-91b9-44eb3b184f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dff2462-dfc6-4ef7-b239-de9df2172431', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dba8bb0-d6bf-481e-a7ca-1e1ac53354ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:21 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Creating offline snapshot 335a8de9-9e9b-4c2b-ae04-480dc8e1f784 of volume 8f81a750-0b29-4688-876c-338cc9d66867 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.609s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:03:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Volume volume-5dff2462-dfc6-4ef7-b239-de9df2172431 (5dff2462-dfc6-4ef7-b239-de9df2172431): created successfully Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dba8bb0-d6bf-481e-a7ca-1e1ac53354ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Flow 'volume_create_manager' (608414df-0843-4bba-b546-397f9b473959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[349177e0-7fe8-459a-abe9-45a943454ed6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:21 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bb47e9b4-0f0f-45b1-8a1c-e5948fe4d670 tempest-ServerRescueNegativeTestJSON-2108469710 None] Created volume successfully. Nov 02 10:03:21 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 Nov 02 10:03:21 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:22 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867" returned: 0 in 0.961s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:22 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 1G Nov 02 10:03:22 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:23 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-94a63b40-ddf7-4f73-b106-8d8934166a05 req-67961657-3809-4f5a-94af-6f9ef245fae3 tempest-ServerActionsTestOtherA-1016928452 None] Terminate volume connection completed successfully. Nov 02 10:03:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-94a63b40-ddf7-4f73-b106-8d8934166a05 req-67961657-3809-4f5a-94af-6f9ef245fae3 tempest-ServerActionsTestOtherA-1016928452 None] Deleting attachment 3ef72af0-5810-43f4-b95f-8b174a54122f. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:03:23 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 1G" returned: 0 in 0.773s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f81a750-0b29-4688-876c-338cc9d66867 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:23 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f81a750-0b29-4688-876c-338cc9d66867 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 Nov 02 10:03:23 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:23 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f81a750-0b29-4688-876c-338cc9d66867 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784" returned: 0 in 0.530s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:23 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 is being set with open permissions: ugo+rw Nov 02 10:03:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:23 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 Nov 02 10:03:23 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:24 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784" returned: 0 in 0.770s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:24 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.info Nov 02 10:03:24 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:25 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.info" returned: 0 in 0.618s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:25 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.info is being set with open permissions: ugo+rw Nov 02 10:03:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:25 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.info Nov 02 10:03:25 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:26 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.info" returned: 0 in 0.855s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.810s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d05f0713-ce50-4bd2-9799-6f522ba092c2 tempest-VolumesExtendTest-1913797569 None] Create snapshot completed successfully Nov 02 10:03:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c93e0e6b-4da4-4722-ab2e-4a07a5c6c8fd tempest-VolumesExtendTest-1913797569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c93e0e6b-4da4-4722-ab2e-4a07a5c6c8fd tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:27 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b951c2-8e1f-4f57-b5b6-805c2876a8d0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c93e0e6b-4da4-4722-ab2e-4a07a5c6c8fd tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:28 devstack sudo[92050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 Nov 02 10:03:28 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:28 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c93e0e6b-4da4-4722-ab2e-4a07a5c6c8fd tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867" returned: 0 in 0.760s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c93e0e6b-4da4-4722-ab2e-4a07a5c6c8fd tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 2G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c93e0e6b-4da4-4722-ab2e-4a07a5c6c8fd tempest-VolumesExtendTest-1913797569 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 2G" returned: 0 in 0.340s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c93e0e6b-4da4-4722-ab2e-4a07a5c6c8fd tempest-VolumesExtendTest-1913797569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.246s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:29 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c93e0e6b-4da4-4722-ab2e-4a07a5c6c8fd tempest-VolumesExtendTest-1913797569 None] Extend volume completed successfully. Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "cinder-335a8de9-9e9b-4c2b-ae04-480dc8e1f784-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-335a8de9-9e9b-4c2b-ae04-480dc8e1f784-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "cinder-quobyte-8f81a750-0b29-4688-876c-338cc9d66867" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-quobyte-8f81a750-0b29-4688-876c-338cc9d66867" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Acquiring lock "cinder-quobyte-335a8de9-9e9b-4c2b-ae04-480dc8e1f784" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-quobyte-335a8de9-9e9b-4c2b-ae04-480dc8e1f784" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Deleting offline snapshot 335a8de9-9e9b-4c2b-ae04-480dc8e1f784 of volume 8f81a750-0b29-4688-876c-338cc9d66867 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] snapshot_file for this snap is: volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed816da-06d4-4b25-9bb3-d785cb97f061]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:31 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 Nov 02 10:03:31 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:32 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784" returned: 0 in 1.310s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f81a750-0b29-4688-876c-338cc9d66867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:03:32 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4171f894-4243-44a1-91d6-c0c6a6cb3b28]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:32 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 Nov 02 10:03:32 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:33 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867" returned: 0 in 0.942s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:33 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 Nov 02 10:03:33 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:33 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784" returned: 0 in 0.655s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:33 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784 Nov 02 10:03:33 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:34 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867.335a8de9-9e9b-4c2b-ae04-480dc8e1f784" returned: 0 in 0.370s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-quobyte-335a8de9-9e9b-4c2b-ae04-480dc8e1f784" released by "_delete_snapshot" :: held 3.561s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-quobyte-8f81a750-0b29-4688-876c-338cc9d66867" released by "delete_snapshot" :: held 3.606s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:34 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Created reservations ['d8984cdb-574b-4107-942a-5002ab3d0f64', 'e36406ff-0f91-4b5d-9f30-05e195b84f74', 'fc3920a8-bcf5-4fb4-9fc6-f2026264451b', 'c4c4394b-f35b-41d5-aa9b-9599d353e3b9'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Delete snapshot completed successfully. Nov 02 10:03:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-158af457-2dcb-4442-b4cf-822655ad85b5 tempest-VolumesExtendTest-1913797569 None] Lock "cinder-335a8de9-9e9b-4c2b-ae04-480dc8e1f784-delete_snapshot" released by "delete_snapshot" :: held 3.889s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Acquiring lock "cinder-8f81a750-0b29-4688-876c-338cc9d66867-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Lock "cinder-8f81a750-0b29-4688-876c-338cc9d66867-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Acquiring lock "cinder-quobyte-8f81a750-0b29-4688-876c-338cc9d66867" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Lock "cinder-quobyte-8f81a750-0b29-4688-876c-338cc9d66867" acquired by "delete_volume" :: waited 0.061s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:35 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c923256-b759-4be3-b70e-8d35efcf95d3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:36 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 Nov 02 10:03:36 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Acquiring lock "cinder-5dff2462-dfc6-4ef7-b239-de9df2172431-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "cinder-5dff2462-dfc6-4ef7-b239-de9df2172431-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Acquiring lock "cinder-quobyte-5dff2462-dfc6-4ef7-b239-de9df2172431" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "cinder-quobyte-5dff2462-dfc6-4ef7-b239-de9df2172431" acquired by "delete_volume" :: waited 0.090s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:36 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9c9ec7-b566-4d95-946d-bf8857db9b73]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:36 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867" returned: 0 in 1.051s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:36 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867 Nov 02 10:03:36 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:37 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431 Nov 02 10:03:37 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:37 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8f81a750-0b29-4688-876c-338cc9d66867" returned: 0 in 0.768s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Lock "cinder-quobyte-8f81a750-0b29-4688-876c-338cc9d66867" released by "delete_volume" :: held 2.097s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:37 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Created reservations ['b1310a2a-296a-4752-989e-723e60ac9d4f', 'c031be5d-6198-479d-969a-2dd86829aca6', '1de4ed06-8055-42f7-9cf0-60afaa9ee892', 'b88d161c-78c8-46c3-8b99-50a6bad7ef11'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:38 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431" returned: 0 in 1.393s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:38 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431 Nov 02 10:03:38 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:38 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:03:38 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:39 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5dff2462-dfc6-4ef7-b239-de9df2172431" returned: 0 in 0.947s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "cinder-quobyte-5dff2462-dfc6-4ef7-b239-de9df2172431" released by "delete_volume" :: held 2.487s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:39 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.893s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Deleted volume successfully. Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (e78f8e5f-02c5-44b1-8df7-4c2ce3c97d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c026b87-db3c-4e59-875f-9a4855b8f473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Flow 'volume_create_manager' (193039b1-e90f-4d1f-b3e9-bf22646b47c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abad493-053c-44ee-9e55-3b40eee5aa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Created reservations ['744f16e8-be31-4beb-a9ed-c8de2501d95d', '43c80856-5694-421a-ab6b-091b57a6b93d', 'bc58948e-2953-4c07-9205-6a4f76c3f80e', '89442ee7-6099-481b-95c9-84ebcebff8cf'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c026b87-db3c-4e59-875f-9a4855b8f473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-500896670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f0d521-fb81-4064-98eb-50e518d7446f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:39Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed773790-8cb5-4c8d-bd0c-fca41a5643e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed773790-8cb5-4c8d-bd0c-fca41a5643e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b0d9ce-6697-41b7-91e9-2edbcabcbd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b0d9ce-6697-41b7-91e9-2edbcabcbd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f0d521-fb81-4064-98eb-50e518d7446f', 'volume_name': 'volume-89f0d521-fb81-4064-98eb-50e518d7446f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94951b26-d593-42d5-827b-145482145fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94951b26-d593-42d5-827b-145482145fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7dc933f-c9fb-4b7c-a5f0-436ceefd02b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:39 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Volume 89f0d521-fb81-4064-98eb-50e518d7446f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f0d521-fb81-4064-98eb-50e518d7446f', 'volume_size': 1} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-500896670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f0d521-fb81-4064-98eb-50e518d7446f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:39Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Creating volume 89f0d521-fb81-4064-98eb-50e518d7446f {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:39 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abad493-053c-44ee-9e55-3b40eee5aa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1700415435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4434f34b-cf46-4c6b-8d71-5a9c53d6554c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35727c48a4374ef79f5dc04a4c91fb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:39Z,use_quota=True,user_id='2c9816f71cda41f398bacd238191c5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c8868c-a890-4860-9f59-b8921e863d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c8868c-a890-4860-9f59-b8921e863d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:39 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f 1073741824 Nov 02 10:03:39 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd0dd61-bbd1-49f1-8e5a-1691b66d3114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:03:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c32a4c9e-7625-4dec-bca4-5ede2102dd3f tempest-VolumesExtendTest-1913797569 None] Lock "cinder-8f81a750-0b29-4688-876c-338cc9d66867-delete_volume" released by "delete_volume" :: held 4.648s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:40 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:03:40 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:41 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd0dd61-bbd1-49f1-8e5a-1691b66d3114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4434f34b-cf46-4c6b-8d71-5a9c53d6554c', 'volume_name': 'volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543ae072-f36b-4742-986e-9ae41a44b22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543ae072-f36b-4742-986e-9ae41a44b22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816f61c2-e99d-4ced-a740-1e32dca8060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:41 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Volume 4434f34b-cf46-4c6b-8d71-5a9c53d6554c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Trying to clone 4434f34b-cf46-4c6b-8d71-5a9c53d6554c from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.977s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:41 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:41 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Deleted volume successfully. Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f 1073741824" returned: 0 in 1.453s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86f77013-c9cc-49ee-bf86-9b45b743bfa5 tempest-ServerRescueNegativeTestJSON-2108469710 None] Lock "cinder-5dff2462-dfc6-4ef7-b239-de9df2172431-delete_volume" released by "delete_volume" :: held 5.017s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:41 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f Nov 02 10:03:41 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:42 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f" returned: 0 in 1.141s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] <== create_volume: return (2731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.738s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD, size 20.69 MB, duration 1.42 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:03:42 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Image download 20.69 MB at 14.52 MB/s Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7dc933f-c9fb-4b7c-a5f0-436ceefd02b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f0d521-fb81-4064-98eb-50e518d7446f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826735c8-bdc5-4572-9a5d-1d224ee24ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:42 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Volume volume-89f0d521-fb81-4064-98eb-50e518d7446f (89f0d521-fb81-4064-98eb-50e518d7446f): created successfully Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826735c8-bdc5-4572-9a5d-1d224ee24ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (e78f8e5f-02c5-44b1-8df7-4c2ce3c97d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf99f48-70e9-49dd-ad71-ef865887f0b4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:42 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-22e8afad-d854-4752-82dc-3975748b4fe5 tempest-VolumesActionsTest-148999138 None] Created volume successfully. Nov 02 10:03:43 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD Nov 02 10:03:43 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a57d74f1-17f8-49ad-b781-9e29a0e14e3b tempest-VolumesActionsTest-148999138 None] Acquiring lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f" by "attach_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a57d74f1-17f8-49ad-b781-9e29a0e14e3b tempest-VolumesActionsTest-148999138 None] Lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f" acquired by "attach_volume" :: waited 0.096s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:43 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=55,cinder:UPDATE=51,cinder:INSERT=20,cinder:DELETE=4 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:03:43 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD" returned: 0 in 1.049s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:43 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 is fetched for user 2c9816f71cda41f398bacd238191c5e1. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:03:43 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=50,cinder:UPDATE=52,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:03:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a57d74f1-17f8-49ad-b781-9e29a0e14e3b tempest-VolumesActionsTest-148999138 None] Attaching volume 89f0d521-fb81-4064-98eb-50e518d7446f to instance d72e9496-1fdd-4a3b-aacf-82852976e74c at mountpoint /dev/vdb on host None. Nov 02 10:03:44 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fe26d9-7f73-412d-8b3d-70a1c478523e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a57d74f1-17f8-49ad-b781-9e29a0e14e3b tempest-VolumesActionsTest-148999138 None] Attach volume completed successfully. Nov 02 10:03:44 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a57d74f1-17f8-49ad-b781-9e29a0e14e3b tempest-VolumesActionsTest-148999138 None] Lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f" released by "attach_volume" :: held 0.610s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:44 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD Nov 02 10:03:44 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:45 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD" returned: 0 in 1.048s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1700415435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4434f34b-cf46-4c6b-8d71-5a9c53d6554c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35727c48a4374ef79f5dc04a4c91fb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:39Z,use_quota=True,user_id='2c9816f71cda41f398bacd238191c5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Creating volume 4434f34b-cf46-4c6b-8d71-5a9c53d6554c {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:45 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:03:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:45 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c 1073741824 Nov 02 10:03:45 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:46 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c 1073741824" returned: 0 in 1.522s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:47 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c Nov 02 10:03:47 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7a5decf4-e452-4b38-9f86-873be42f2864 tempest-VolumesActionsTest-1922789493 None] Terminate volume connection completed successfully. Nov 02 10:03:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7a5decf4-e452-4b38-9f86-873be42f2864 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f-detach_volume" by "detach_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:47 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c" returned: 0 in 0.648s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7a5decf4-e452-4b38-9f86-873be42f2864 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f-detach_volume" acquired by "detach_volume" :: waited 0.069s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:47 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Attempting download of 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume 4434f34b-cf46-4c6b-8d71-5a9c53d6554c. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:03:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7a5decf4-e452-4b38-9f86-873be42f2864 tempest-VolumesActionsTest-1922789493 None] Detaching volume 89f0d521-fb81-4064-98eb-50e518d7446f from instance d72e9496-1fdd-4a3b-aacf-82852976e74c. Nov 02 10:03:47 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f11ffc-a396-476a-967d-d9ecf6725139]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_f7ma0lvn {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7a5decf4-e452-4b38-9f86-873be42f2864 tempest-VolumesActionsTest-1922789493 None] Detach volume completed successfully. Nov 02 10:03:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7a5decf4-e452-4b38-9f86-873be42f2864 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f-detach_volume" released by "detach_volume" :: held 0.282s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:48 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_f7ma0lvn Nov 02 10:03:48 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8d916dff-de7a-4b29-b065-601b8f409726 tempest-VolumesActionsTest-148999138 None] Acquiring lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f-detach_volume" by "detach_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8d916dff-de7a-4b29-b065-601b8f409726 tempest-VolumesActionsTest-148999138 None] Lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8d916dff-de7a-4b29-b065-601b8f409726 tempest-VolumesActionsTest-148999138 None] Volume detach called, but volume not attached. Nov 02 10:03:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8d916dff-de7a-4b29-b065-601b8f409726 tempest-VolumesActionsTest-148999138 None] Lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:48 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_f7ma0lvn" returned: 0 in 0.921s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_f7ma0lvn {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:49 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_f7ma0lvn Nov 02 10:03:49 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Acquiring lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Acquiring lock "cinder-quobyte-89f0d521-fb81-4064-98eb-50e518d7446f" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Lock "cinder-quobyte-89f0d521-fb81-4064-98eb-50e518d7446f" acquired by "delete_volume" :: waited 0.036s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[910a93f7-c1dd-4d6f-8633-fca9a3bc98b5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:49 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_f7ma0lvn" returned: 1 in 0.702s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_f7ma0lvn' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c955463-c876-4e73-8057-0eb5989c50aa]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:49 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f Nov 02 10:03:49 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:49 devstack sudo[92333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD Nov 02 10:03:49 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:49 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f" returned: 0 in 0.601s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:50 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f Nov 02 10:03:50 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:50 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD" returned: 0 in 0.963s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:50 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 was qcow2, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:03:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:50 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c Nov 02 10:03:50 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:50 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-89f0d521-fb81-4064-98eb-50e518d7446f" returned: 0 in 0.689s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Lock "cinder-quobyte-89f0d521-fb81-4064-98eb-50e518d7446f" released by "delete_volume" :: held 1.405s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:50 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Created reservations ['a39837c4-63ca-4e1e-8d2f-8d028b796705', '4efb7938-572c-488c-9e2f-39c8b8902492', '4e30f501-6d73-4be5-ac04-d02fecef9df1', '90228f1f-6fc0-4d3c-85d8-dd8501c479b9'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:51 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:03:51 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:51 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.383s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:51 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:03:51 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Deleted volume successfully. Nov 02 10:03:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfcb51a7-c705-424a-9c63-cecc4a222f12 tempest-VolumesActionsTest-148999138 None] Lock "cinder-89f0d521-fb81-4064-98eb-50e518d7446f-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:53 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c" returned: 0 in 3.485s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:53 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_9f73z_2gdevstack@QuobyteHD, size 112.00 MB, duration 3.49 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:03:53 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Converted 112.00 MB image at 32.13 MB/s Nov 02 10:03:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:53 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c 1G Nov 02 10:03:53 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:54 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c 1G" returned: 0 in 0.574s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Downloaded image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume 4434f34b-cf46-4c6b-8d71-5a9c53d6554c successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 for user 2c9816f71cda41f398bacd238191c5e1 is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Marking volume 4434f34b-cf46-4c6b-8d71-5a9c53d6554c as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Copying metadata from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 to 4434f34b-cf46-4c6b-8d71-5a9c53d6554c. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Creating volume glance metadata for volume 4434f34b-cf46-4c6b-8d71-5a9c53d6554c backed by image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816f61c2-e99d-4ced-a740-1e32dca8060e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334261f0-67e3-492d-bf7c-04b4348739d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:54 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Volume volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c (4434f34b-cf46-4c6b-8d71-5a9c53d6554c): created successfully Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334261f0-67e3-492d-bf7c-04b4348739d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Flow 'volume_create_manager' (193039b1-e90f-4d1f-b3e9-bf22646b47c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:54 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-27c54b6d-bcbf-434d-8f11-fbf476a3fde5 tempest-ServerActionsTestOtherA-1016928452 None] Created volume successfully. Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (0c16c3fd-a35b-4d59-9c05-b3d03b538b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c54f541-300e-4cd0-8b1a-ca11c5f4ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c54f541-300e-4cd0-8b1a-ca11c5f4ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-369962982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f06e07-ccf2-4b74-9db9-5a4450b49216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:56Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e8c789-e93e-435a-9c73-4f8a05edbfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e8c789-e93e-435a-9c73-4f8a05edbfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43973464-f11c-46d6-809a-66e5c08eb100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43973464-f11c-46d6-809a-66e5c08eb100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f06e07-ccf2-4b74-9db9-5a4450b49216', 'volume_name': 'volume-24f06e07-ccf2-4b74-9db9-5a4450b49216', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f63134-d1e2-4123-8f2b-dcf88b2fdd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f63134-d1e2-4123-8f2b-dcf88b2fdd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54968f21-d9df-46ce-8cfa-4b59b5336852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:56 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Volume 24f06e07-ccf2-4b74-9db9-5a4450b49216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f06e07-ccf2-4b74-9db9-5a4450b49216', 'volume_size': 1} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-369962982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f06e07-ccf2-4b74-9db9-5a4450b49216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:56Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Creating volume 24f06e07-ccf2-4b74-9db9-5a4450b49216 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:03:56 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:56 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 1073741824 Nov 02 10:03:56 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:56 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 1073741824" returned: 0 in 0.564s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:57 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 Nov 02 10:03:57 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:57 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216" returned: 0 in 0.365s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:03:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54968f21-d9df-46ce-8cfa-4b59b5336852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f06e07-ccf2-4b74-9db9-5a4450b49216', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de6e528-7140-4ead-9e61-a81deca00ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:03:57 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Volume volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 (24f06e07-ccf2-4b74-9db9-5a4450b49216): created successfully Nov 02 10:03:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de6e528-7140-4ead-9e61-a81deca00ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:03:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (0c16c3fd-a35b-4d59-9c05-b3d03b538b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:03:57 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-282c7e8a-3324-4941-b4fb-a96180df3f54 tempest-VolumesActionsTest-148999138 None] Created volume successfully. Nov 02 10:03:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "cinder-24f06e07-ccf2-4b74-9db9-5a4450b49216-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-24f06e07-ccf2-4b74-9db9-5a4450b49216-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "cinder-quobyte-24f06e07-ccf2-4b74-9db9-5a4450b49216" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:03:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-quobyte-24f06e07-ccf2-4b74-9db9-5a4450b49216" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:03:58 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ab6789-e2c7-4577-8a9e-47f26b0c2079]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:03:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:58 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 Nov 02 10:03:58 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:59 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216" returned: 0 in 0.505s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:59 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216 Nov 02 10:03:59 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:03:59 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-24f06e07-ccf2-4b74-9db9-5a4450b49216" returned: 0 in 0.320s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-quobyte-24f06e07-ccf2-4b74-9db9-5a4450b49216" released by "delete_volume" :: held 0.907s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Created reservations ['c639ca36-31ef-42d2-a177-c931023a7942', 'bfe72837-8bee-4e05-b4ab-45894fe1927f', '3307d42d-2146-4c8b-8222-04f8162eb2a2', '2a04f18b-61c8-4451-9fdd-723f6acf1684'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:03:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:03:59 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:03:59 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:00 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.371s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:00 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Deleted volume successfully. Nov 02 10:04:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ae09c60-cf09-4384-a851-3e958b5f7a61 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-24f06e07-ccf2-4b74-9db9-5a4450b49216-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (922f3aaf-33a6-4447-8e48-78b2592ee6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966da3b2-697a-470a-9428-1ee91a47beec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966da3b2-697a-470a-9428-1ee91a47beec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10270564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50efe1bb-25f9-4e23-b62d-978146e8ace0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:02Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3736d14-9549-4212-aa6a-4609a57eb4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3736d14-9549-4212-aa6a-4609a57eb4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e832e68-e8d9-4ce8-9c56-6bfcc3fea58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e832e68-e8d9-4ce8-9c56-6bfcc3fea58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50efe1bb-25f9-4e23-b62d-978146e8ace0', 'volume_name': 'volume-50efe1bb-25f9-4e23-b62d-978146e8ace0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85918739-71b4-40f0-a608-54201bfcab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85918739-71b4-40f0-a608-54201bfcab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb8878e-a15d-43b2-b3e3-2606c197dc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:01 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Volume 50efe1bb-25f9-4e23-b62d-978146e8ace0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50efe1bb-25f9-4e23-b62d-978146e8ace0', 'volume_size': 1} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10270564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50efe1bb-25f9-4e23-b62d-978146e8ace0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:02Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Creating volume 50efe1bb-25f9-4e23-b62d-978146e8ace0 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:01 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:04:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:01 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 1073741824 Nov 02 10:04:01 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:02 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 1073741824" returned: 0 in 0.866s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:02 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 Nov 02 10:04:02 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:02 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0" returned: 0 in 0.312s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb8878e-a15d-43b2-b3e3-2606c197dc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50efe1bb-25f9-4e23-b62d-978146e8ace0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5da343-6719-4cac-aad0-2f8c80d46a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Volume volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 (50efe1bb-25f9-4e23-b62d-978146e8ace0): created successfully Nov 02 10:04:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5da343-6719-4cac-aad0-2f8c80d46a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (922f3aaf-33a6-4447-8e48-78b2592ee6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a6c00407-2f73-4724-9957-3fc9c8122018 tempest-VolumesActionsTest-148999138 None] Created volume successfully. Nov 02 10:04:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-eb1cff7c-661c-494a-aecb-961605f3ed5d req-6585dbe7-9db5-47c3-84c0-836fa0973f49 tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-eb1cff7c-661c-494a-aecb-961605f3ed5d req-6585dbe7-9db5-47c3-84c0-836fa0973f49 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-eb1cff7c-661c-494a-aecb-961605f3ed5d req-6585dbe7-9db5-47c3-84c0-836fa0973f49 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-eb1cff7c-661c-494a-aecb-961605f3ed5d req-6585dbe7-9db5-47c3-84c0-836fa0973f49 tempest-ServerActionsTestOtherA-1016928452 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98b08771-2b6a-4d63-87c6-b1e81fb9c5e8', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:04:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-eb1cff7c-661c-494a-aecb-961605f3ed5d req-6585dbe7-9db5-47c3-84c0-836fa0973f49 tempest-ServerActionsTestOtherA-1016928452 None] attachment_update completed successfully. Nov 02 10:04:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Acquiring lock "cinder-50efe1bb-25f9-4e23-b62d-978146e8ace0-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Lock "cinder-50efe1bb-25f9-4e23-b62d-978146e8ace0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Acquiring lock "cinder-quobyte-50efe1bb-25f9-4e23-b62d-978146e8ace0" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Lock "cinder-quobyte-50efe1bb-25f9-4e23-b62d-978146e8ace0" acquired by "delete_volume" :: waited 0.041s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d940d2-6619-44f6-8fed-a36b3e2f3f8e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:04 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 Nov 02 10:04:04 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:04 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0" returned: 0 in 0.480s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:04 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0 Nov 02 10:04:04 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:05 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-50efe1bb-25f9-4e23-b62d-978146e8ace0" returned: 0 in 0.338s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Lock "cinder-quobyte-50efe1bb-25f9-4e23-b62d-978146e8ace0" released by "delete_volume" :: held 0.889s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Created reservations ['a572a5a1-be2b-4b0a-a5b2-bea12b46290a', 'ece0a2db-7842-4f96-a5e0-8e38487fa6d8', '9c209997-047d-4ad3-84db-4ed699ef88cc', 'ed9f0f6c-109f-40f6-b280-58aac4c61c4c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:05 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:04:05 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:05 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:05 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Deleted volume successfully. Nov 02 10:04:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ced1b7c9-d7d4-44d8-b796-3ff25c9c79fd tempest-VolumesActionsTest-1922789493 None] Lock "cinder-50efe1bb-25f9-4e23-b62d-978146e8ace0-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (1be381af-90e6-4c19-86fb-1c85448aad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996a348b-7b16-4ae3-89c5-f501a470c6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996a348b-7b16-4ae3-89c5-f501a470c6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894563705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bef9847-dbeb-45b7-ba11-fc46e87dea1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:07Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc28433-234e-4665-ae18-2da5957d30af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc28433-234e-4665-ae18-2da5957d30af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c30ce4-edf5-4952-8025-4105fbc43927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c30ce4-edf5-4952-8025-4105fbc43927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bef9847-dbeb-45b7-ba11-fc46e87dea1e', 'volume_name': 'volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca79868-5dc7-4258-aca3-a72d3a20d395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca79868-5dc7-4258-aca3-a72d3a20d395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542db3de-0624-4ec5-aa7a-4aab327ee59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Volume 4bef9847-dbeb-45b7-ba11-fc46e87dea1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e', 'volume_size': 1} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894563705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bef9847-dbeb-45b7-ba11-fc46e87dea1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:07Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Creating volume 4bef9847-dbeb-45b7-ba11-fc46e87dea1e {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:07 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:07 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e 1073741824 Nov 02 10:04:07 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:07 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e 1073741824" returned: 0 in 0.617s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:07 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e Nov 02 10:04:07 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:08 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e" returned: 0 in 0.323s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542db3de-0624-4ec5-aa7a-4aab327ee59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfd5b01-add1-4777-8da7-f3a0c4bee743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Volume volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e (4bef9847-dbeb-45b7-ba11-fc46e87dea1e): created successfully Nov 02 10:04:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfd5b01-add1-4777-8da7-f3a0c4bee743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (1be381af-90e6-4c19-86fb-1c85448aad82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-39c368de-c20c-4b8a-98e7-c7c1c1768c34 tempest-VolumesActionsTest-148999138 None] Created volume successfully. Nov 02 10:04:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "cinder-4bef9847-dbeb-45b7-ba11-fc46e87dea1e-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-4bef9847-dbeb-45b7-ba11-fc46e87dea1e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "cinder-quobyte-4bef9847-dbeb-45b7-ba11-fc46e87dea1e" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-quobyte-4bef9847-dbeb-45b7-ba11-fc46e87dea1e" acquired by "delete_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54b7a87-e1b8-48a2-8490-557987a03a70]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:09 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e Nov 02 10:04:09 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:09 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e" returned: 0 in 0.446s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:10 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e Nov 02 10:04:10 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:10 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4bef9847-dbeb-45b7-ba11-fc46e87dea1e" returned: 0 in 0.324s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-quobyte-4bef9847-dbeb-45b7-ba11-fc46e87dea1e" released by "delete_volume" :: held 0.828s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Created reservations ['122b1713-9273-43a8-aaad-ec9daac372de', '7e2046e6-c78a-4c67-88ff-ec8d79ce3c8a', '151b6b66-177b-46d1-a339-1de940beffc8', '0b2cd9a4-2f51-4e06-b9c3-02e897c2cf77'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:10 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:04:10 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:10 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.328s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Deleted volume successfully. Nov 02 10:04:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ee293ff4-7cc9-4cc7-980b-d482821e59e8 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-4bef9847-dbeb-45b7-ba11-fc46e87dea1e-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (527218b0-2690-40f6-a508-6668b7219a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf71aba-95de-46ab-be65-ac87918b6827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf71aba-95de-46ab-be65-ac87918b6827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1402465199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ebb492-6907-472c-bcdb-c1cbefb13109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:11Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d39db1-2dd0-4079-861d-c842d7f57fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d39db1-2dd0-4079-861d-c842d7f57fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effd6935-c887-4f57-a6f6-bb22205dd267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effd6935-c887-4f57-a6f6-bb22205dd267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ebb492-6907-472c-bcdb-c1cbefb13109', 'volume_name': 'volume-e1ebb492-6907-472c-bcdb-c1cbefb13109', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9914eabf-5a7b-4eee-8311-a72a6982bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9914eabf-5a7b-4eee-8311-a72a6982bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033edf89-f60d-4e46-a969-3648c1c8bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:11 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Volume e1ebb492-6907-472c-bcdb-c1cbefb13109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ebb492-6907-472c-bcdb-c1cbefb13109', 'volume_size': 1} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1402465199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ebb492-6907-472c-bcdb-c1cbefb13109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:11Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Creating volume e1ebb492-6907-472c-bcdb-c1cbefb13109 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:11 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:04:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:11 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 1073741824 Nov 02 10:04:11 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:12 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 1073741824" returned: 0 in 0.699s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:12 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 Nov 02 10:04:12 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:12 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109" returned: 0 in 0.415s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033edf89-f60d-4e46-a969-3648c1c8bc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ebb492-6907-472c-bcdb-c1cbefb13109', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fd60ec-89a1-4442-9bd6-0fe359486e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:12 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Volume volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 (e1ebb492-6907-472c-bcdb-c1cbefb13109): created successfully Nov 02 10:04:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fd60ec-89a1-4442-9bd6-0fe359486e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (527218b0-2690-40f6-a508-6668b7219a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:12 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-abf3964d-7c57-4953-9769-b46e85926764 tempest-VolumesActionsTest-148999138 None] Created volume successfully. Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "cinder-e1ebb492-6907-472c-bcdb-c1cbefb13109-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-e1ebb492-6907-472c-bcdb-c1cbefb13109-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (4d84ea69-2184-44f2-bb75-abc30ed32370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510622db-7b7c-445d-ae27-cc6f6d7b5d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510622db-7b7c-445d-ae27-cc6f6d7b5d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1136833878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54273903-5b21-450e-8496-0ec1f10bf248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66911ba9db8e41e5a007f0fab213e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:14Z,use_quota=True,user_id='a5f84b6c5c7f403a9445433867f3bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e40140-69ff-4721-8c70-658b6cf8dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e40140-69ff-4721-8c70-658b6cf8dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04262980-836f-4001-b70f-1444d4af79fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04262980-836f-4001-b70f-1444d4af79fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54273903-5b21-450e-8496-0ec1f10bf248', 'volume_name': 'volume-54273903-5b21-450e-8496-0ec1f10bf248', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad894e9d-4dc1-4c06-a147-ebd297cfa901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad894e9d-4dc1-4c06-a147-ebd297cfa901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74812db-fd8a-425d-9bd1-ef17fdaaf346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:13 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Volume 54273903-5b21-450e-8496-0ec1f10bf248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54273903-5b21-450e-8496-0ec1f10bf248', 'volume_size': 1} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1136833878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54273903-5b21-450e-8496-0ec1f10bf248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66911ba9db8e41e5a007f0fab213e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:14Z,use_quota=True,user_id='a5f84b6c5c7f403a9445433867f3bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Creating volume 54273903-5b21-450e-8496-0ec1f10bf248 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:13 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:04:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "cinder-quobyte-e1ebb492-6907-472c-bcdb-c1cbefb13109" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:14 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 1073741824 Nov 02 10:04:14 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-quobyte-e1ebb492-6907-472c-bcdb-c1cbefb13109" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:14 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7f1b04-6f52-40ed-aa25-292345a825b8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:14 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 Nov 02 10:04:14 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:14 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109" returned: 0 in 0.619s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:14 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 1073741824" returned: 0 in 0.749s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:14 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109 Nov 02 10:04:14 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:14 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 Nov 02 10:04:14 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:15 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1ebb492-6907-472c-bcdb-c1cbefb13109" returned: 0 in 0.359s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-quobyte-e1ebb492-6907-472c-bcdb-c1cbefb13109" released by "delete_volume" :: held 1.068s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:15 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248" returned: 0 in 0.343s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74812db-fd8a-425d-9bd1-ef17fdaaf346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54273903-5b21-450e-8496-0ec1f10bf248', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76d4a5c-3c98-4008-b93b-4cc0cfd27824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:15 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Volume volume-54273903-5b21-450e-8496-0ec1f10bf248 (54273903-5b21-450e-8496-0ec1f10bf248): created successfully Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76d4a5c-3c98-4008-b93b-4cc0cfd27824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (4d84ea69-2184-44f2-bb75-abc30ed32370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Created reservations ['0f562d82-ae84-450a-8c67-8d84dc524951', '8817cf22-4746-4d4a-975c-8e34a598039e', '3b118aeb-868f-43ed-956d-cc35ca0cb823', 'fd41f518-1148-43e1-ae81-aeb008612cbd'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-579e1f05-5f28-46a0-b835-b024021def77 tempest-VolumesSnapshotTestJSON-1361891677 None] Created volume successfully. Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:15 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:04:15 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:15 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.347s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Deleted volume successfully. Nov 02 10:04:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e593f5ee-f2d0-4c57-be02-12b0d6269685 tempest-VolumesActionsTest-1922789493 None] Lock "cinder-e1ebb492-6907-472c-bcdb-c1cbefb13109-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Creating offline snapshot 06db478f-0702-4eec-90c5-4f09bc53d01e of volume 54273903-5b21-450e-8496-0ec1f10bf248 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:04:16 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[79979abe-1825-4323-926b-4380b0a696c9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:16 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 Nov 02 10:04:16 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (edc73f88-2ecb-4e40-aa82-61870484a7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0b644d-00f2-43d4-81e3-fafcc6e94c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0b644d-00f2-43d4-81e3-fafcc6e94c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298981880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb973cb8-3ba7-45a2-a382-10bed98d004b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:17Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c85b01-6108-45eb-8bba-064b42dbdb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c85b01-6108-45eb-8bba-064b42dbdb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789d6b32-5735-4c8d-9abd-80f93fa0d01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (789d6b32-5735-4c8d-9abd-80f93fa0d01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb973cb8-3ba7-45a2-a382-10bed98d004b', 'volume_name': 'volume-bb973cb8-3ba7-45a2-a382-10bed98d004b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e812ea91-aa05-4b53-9a49-f52ddeaa9940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e812ea91-aa05-4b53-9a49-f52ddeaa9940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d734533d-2b5b-4b15-bab3-adab5f2a28f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:17 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Volume bb973cb8-3ba7-45a2-a382-10bed98d004b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb973cb8-3ba7-45a2-a382-10bed98d004b', 'volume_size': 1} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248" returned: 0 in 0.808s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:17 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e 1G Nov 02 10:04:17 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:18 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e 1G" returned: 0 in 0.968s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54273903-5b21-450e-8496-0ec1f10bf248 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:18 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54273903-5b21-450e-8496-0ec1f10bf248 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e Nov 02 10:04:18 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:18 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54273903-5b21-450e-8496-0ec1f10bf248 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e" returned: 0 in 0.452s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:18 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e is being set with open permissions: ugo+rw Nov 02 10:04:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:18 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e Nov 02 10:04:18 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:19 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e" returned: 0 in 0.462s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:19 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.info Nov 02 10:04:19 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:19 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.info" returned: 0 in 0.332s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:19 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.info is being set with open permissions: ugo+rw Nov 02 10:04:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:19 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.info Nov 02 10:04:19 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:20 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.info" returned: 0 in 0.389s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.563s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.697s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298981880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb973cb8-3ba7-45a2-a382-10bed98d004b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ff742dc94143f9bd6e49f489fa6745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:17Z,use_quota=True,user_id='e5a07f9c85724b068b39e673515f3ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Creating volume bb973cb8-3ba7-45a2-a382-10bed98d004b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:20 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:20 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b 1073741824 Nov 02 10:04:20 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:20 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f62c3fd9-4513-4666-b671-9ba2ed8cb4a1 tempest-VolumesSnapshotTestJSON-1361891677 None] Create snapshot completed successfully Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:20 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:04:20 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:20 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b 1073741824" returned: 0 in 0.740s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:20 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b Nov 02 10:04:20 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-06db478f-0702-4eec-90c5-4f09bc53d01e-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-06db478f-0702-4eec-90c5-4f09bc53d01e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-54273903-5b21-450e-8496-0ec1f10bf248" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:21 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.762s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-54273903-5b21-450e-8496-0ec1f10bf248" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-06db478f-0702-4eec-90c5-4f09bc53d01e" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-06db478f-0702-4eec-90c5-4f09bc53d01e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Deleting offline snapshot 06db478f-0702-4eec-90c5-4f09bc53d01e of volume 54273903-5b21-450e-8496-0ec1f10bf248 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] snapshot_file for this snap is: volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:04:21 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b" returned: 0 in 0.683s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe735011-cec2-4850-9478-2a9ec7ed7171]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d734533d-2b5b-4b15-bab3-adab5f2a28f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb973cb8-3ba7-45a2-a382-10bed98d004b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07dba6d-3b22-4383-876e-e122aebf81c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Volume volume-bb973cb8-3ba7-45a2-a382-10bed98d004b (bb973cb8-3ba7-45a2-a382-10bed98d004b): created successfully Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07dba6d-3b22-4383-876e-e122aebf81c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Flow 'volume_create_manager' (edc73f88-2ecb-4e40-aa82-61870484a7f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:21 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-fe9f2ac0-74b7-4443-a23d-7dc9301c995f tempest-VolumesActionsTest-148999138 None] Created volume successfully. Nov 02 10:04:21 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e Nov 02 10:04:21 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:22 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e" returned: 0 in 0.646s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54273903-5b21-450e-8496-0ec1f10bf248(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:22 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e637fb0-22e5-4500-b33f-61b7b619556b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:22 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 Nov 02 10:04:22 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:23 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248" returned: 0 in 0.824s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:23 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e Nov 02 10:04:23 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Acquiring lock "cinder-bb973cb8-3ba7-45a2-a382-10bed98d004b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Lock "cinder-bb973cb8-3ba7-45a2-a382-10bed98d004b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Acquiring lock "cinder-quobyte-bb973cb8-3ba7-45a2-a382-10bed98d004b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Lock "cinder-quobyte-bb973cb8-3ba7-45a2-a382-10bed98d004b" acquired by "delete_volume" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:24 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91964c1-e415-4d7f-a586-dd2c9d6e0c29]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:24 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e" returned: 0 in 0.860s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:24 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e Nov 02 10:04:24 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:24 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b Nov 02 10:04:24 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:24 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b" returned: 0 in 0.773s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:24 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248.06db478f-0702-4eec-90c5-4f09bc53d01e" returned: 0 in 0.775s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:24 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b Nov 02 10:04:24 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-06db478f-0702-4eec-90c5-4f09bc53d01e" released by "_delete_snapshot" :: held 3.369s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-54273903-5b21-450e-8496-0ec1f10bf248" released by "delete_snapshot" :: held 3.420s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Created reservations ['fad6d1c9-2ad6-4514-a7a1-8e188232d9cc', 'db1a7771-196b-4c96-a50c-21c436b8fbe1', '6ee5dbea-f220-458e-8db7-8b40a266b98c', 'c28e0bdd-9a21-4d1d-aab0-46d39d5d3a3f'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Delete snapshot completed successfully. Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71c624bc-94ea-404d-a4a5-796443964431 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-06db478f-0702-4eec-90c5-4f09bc53d01e-delete_snapshot" released by "delete_snapshot" :: held 3.920s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:25 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb973cb8-3ba7-45a2-a382-10bed98d004b" returned: 0 in 0.643s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Lock "cinder-quobyte-bb973cb8-3ba7-45a2-a382-10bed98d004b" released by "delete_volume" :: held 1.497s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Created reservations ['fbd2f88d-d8ff-4995-9045-7cbf4f52a693', '57dcf10d-30fe-452d-8db3-473bb9ce43d3', '450b595d-95fb-4aa1-ab19-dd68a3f5ae13', '5131bcf7-2385-43f6-9bd3-14177ecdec30'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:25 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:04:25 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:26 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.675s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:26 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Deleted volume successfully. Nov 02 10:04:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eee8a267-7307-4797-99d8-ab498e2c49c9 tempest-VolumesActionsTest-148999138 None] Lock "cinder-bb973cb8-3ba7-45a2-a382-10bed98d004b-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (ccb9958c-3539-4df1-80e5-e287b42a199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12323ffa-4092-4cdb-b60d-c5b36c7a5cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12323ffa-4092-4cdb-b60d-c5b36c7a5cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1245317701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b48bc3-4c43-4283-a379-20848739c21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66911ba9db8e41e5a007f0fab213e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:27Z,use_quota=True,user_id='a5f84b6c5c7f403a9445433867f3bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78b1429-1505-443e-bfa1-1b7012d26cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78b1429-1505-443e-bfa1-1b7012d26cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a02a9c-7d81-4adf-9b4a-b887314d563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a02a9c-7d81-4adf-9b4a-b887314d563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b48bc3-4c43-4283-a379-20848739c21a', 'volume_name': 'volume-b6b48bc3-4c43-4283-a379-20848739c21a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992b8a5d-07ee-402b-aa90-742544f5b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992b8a5d-07ee-402b-aa90-742544f5b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63104fc-fc2e-4380-853f-fa448dbf9530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:27 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Volume b6b48bc3-4c43-4283-a379-20848739c21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b48bc3-4c43-4283-a379-20848739c21a', 'volume_size': 1} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1245317701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b48bc3-4c43-4283-a379-20848739c21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66911ba9db8e41e5a007f0fab213e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:27Z,use_quota=True,user_id='a5f84b6c5c7f403a9445433867f3bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Creating volume b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:27 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:04:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:27 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a 1073741824 Nov 02 10:04:27 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:28 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a 1073741824" returned: 0 in 1.103s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:28 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a Nov 02 10:04:28 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:29 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a" returned: 0 in 0.417s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63104fc-fc2e-4380-853f-fa448dbf9530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b48bc3-4c43-4283-a379-20848739c21a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8e50b8-4cc6-4f94-9b9e-8f43c3534c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:29 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Volume volume-b6b48bc3-4c43-4283-a379-20848739c21a (b6b48bc3-4c43-4283-a379-20848739c21a): created successfully Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8e50b8-4cc6-4f94-9b9e-8f43c3534c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (ccb9958c-3539-4df1-80e5-e287b42a199d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:29 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8c4584e5-135c-4225-9f27-9e84b110b3e3 tempest-VolumesSnapshotTestJSON-1361891677 None] Created volume successfully. Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Creating offline snapshot 63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 of volume b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaafd93-185f-4f7e-b237-0f888bf8ceb3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:30 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a Nov 02 10:04:30 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:30 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a" returned: 0 in 0.703s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:30 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 1G Nov 02 10:04:30 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:31 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 1G" returned: 0 in 0.944s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b48bc3-4c43-4283-a379-20848739c21a -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:31 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b48bc3-4c43-4283-a379-20848739c21a -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 Nov 02 10:04:31 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:32 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b48bc3-4c43-4283-a379-20848739c21a -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794" returned: 0 in 0.635s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:32 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 is being set with open permissions: ugo+rw Nov 02 10:04:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:32 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 Nov 02 10:04:32 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:32 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794" returned: 0 in 0.621s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:33 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.info Nov 02 10:04:33 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:33 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.info" returned: 0 in 0.396s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:33 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.info is being set with open permissions: ugo+rw Nov 02 10:04:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:33 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.info Nov 02 10:04:33 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:33 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.info" returned: 0 in 0.296s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.770s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a767fabc-4e49-4c12-a20c-88da9277f518 tempest-VolumesSnapshotTestJSON-1361891677 None] Create snapshot completed successfully Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (aa4a59b0-ab08-4dec-acd9-18af7ef92fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c674464a-061c-4393-87ec-50bdf0cd3a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c674464a-061c-4393-87ec-50bdf0cd3a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-844483552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786518c4-37e2-4351-9f89-ef9cc21a997a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66911ba9db8e41e5a007f0fab213e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:36Z,use_quota=True,user_id='a5f84b6c5c7f403a9445433867f3bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cabeda-4347-4a3a-a6d3-75092fcbf0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cabeda-4347-4a3a-a6d3-75092fcbf0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1800504f-eacb-4fad-88d5-8e5459fa6e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1800504f-eacb-4fad-88d5-8e5459fa6e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '786518c4-37e2-4351-9f89-ef9cc21a997a', 'volume_name': 'volume-786518c4-37e2-4351-9f89-ef9cc21a997a', 'volume_size': 2, 'snapshot_id': '63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a43f53e-0819-4cb9-96e3-c8750d9be7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a43f53e-0819-4cb9-96e3-c8750d9be7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6a73d7-b643-418e-b24e-d9e7f6468981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:36 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Volume 786518c4-37e2-4351-9f89-ef9cc21a997a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-786518c4-37e2-4351-9f89-ef9cc21a997a', 'volume_size': 2, 'snapshot_id': '63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794'} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794-786518c4-37e2-4351-9f89-ef9cc21a997a" by "_create_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:36 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-3b960f5d-505a-4e3f-a2b6-4b84ba8bac17 req-eb51528f-bd51-41f3-85f7-dbf049618a5e tempest-ServerActionsTestOtherA-1016928452 None] Terminate volume connection completed successfully. Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-3b960f5d-505a-4e3f-a2b6-4b84ba8bac17 req-eb51528f-bd51-41f3-85f7-dbf049618a5e tempest-ServerActionsTestOtherA-1016928452 None] Deleting attachment 98b08771-2b6a-4d63-87c6-b1e81fb9c5e8. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794-786518c4-37e2-4351-9f89-ef9cc21a997a" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Creating volume 786518c4-37e2-4351-9f89-ef9cc21a997a from snapshot 63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 {{(pid=86840) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-786518c4-37e2-4351-9f89-ef9cc21a997a" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-786518c4-37e2-4351-9f89-ef9cc21a997a" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] snapshot: 63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794, volume: 786518c4-37e2-4351-9f89-ef9cc21a997a, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff8a416-93d6-4a33-acfd-ed84e82137d3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:36 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 Nov 02 10:04:36 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:37 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794" returned: 0 in 0.960s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b48bc3-4c43-4283-a379-20848739c21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:37 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7ba039-98c4-4bbb-b2cc-65c221bf94b5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:37 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a Nov 02 10:04:37 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:38 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a" returned: 0 in 0.886s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:04:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:04:38 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:04:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:38 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a Nov 02 10:04:38 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-3b960f5d-505a-4e3f-a2b6-4b84ba8bac17 req-710017d4-c0b4-453f-ab63-5aaf266fee8b tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:46 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=89,cinder:UPDATE=88,cinder:INSERT=20,cinder:DELETE=7 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:04:48 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a" returned: 0 in 10.175s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:48 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a, size 1024.00 MB, duration 10.18 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:04:48 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Converted 1024.00 MB image at 100.63 MB/s Nov 02 10:04:48 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a is being set with open permissions: ugo+rw Nov 02 10:04:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:48 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a Nov 02 10:04:48 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:48 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a" returned: 0 in 0.279s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-786518c4-37e2-4351-9f89-ef9cc21a997a" released by "_copy_volume_from_snapshot" :: held 12.460s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:48 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=90,cinder:UPDATE=88,cinder:INSERT=32,cinder:DELETE=9 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:04:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794-786518c4-37e2-4351-9f89-ef9cc21a997a" released by "_create_volume_from_snapshot" :: held 12.572s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.619s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-3b960f5d-505a-4e3f-a2b6-4b84ba8bac17 req-710017d4-c0b4-453f-ab63-5aaf266fee8b tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.543s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-3b960f5d-505a-4e3f-a2b6-4b84ba8bac17 req-710017d4-c0b4-453f-ab63-5aaf266fee8b tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6a73d7-b643-418e-b24e-d9e7f6468981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786518c4-37e2-4351-9f89-ef9cc21a997a', 'volume_size': 2, 'snapshot_id': '63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0833cf93-7bfe-487b-b29f-7a38bdbe14d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:49 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Volume volume-786518c4-37e2-4351-9f89-ef9cc21a997a (786518c4-37e2-4351-9f89-ef9cc21a997a): created successfully Nov 02 10:04:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0833cf93-7bfe-487b-b29f-7a38bdbe14d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (aa4a59b0-ab08-4dec-acd9-18af7ef92fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-3b960f5d-505a-4e3f-a2b6-4b84ba8bac17 req-710017d4-c0b4-453f-ab63-5aaf266fee8b tempest-ServerActionsTestOtherA-1016928452 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c240a6b-42a7-47bc-b13d-d9c32f31f07d', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:04:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-dd3c7c57-f090-428b-be5b-68c9ad6e4584 tempest-VolumesSnapshotTestJSON-1361891677 None] Created volume successfully. Nov 02 10:04:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-3b960f5d-505a-4e3f-a2b6-4b84ba8bac17 req-710017d4-c0b4-453f-ab63-5aaf266fee8b tempest-ServerActionsTestOtherA-1016928452 None] attachment_update completed successfully. Nov 02 10:04:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-786518c4-37e2-4351-9f89-ef9cc21a997a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-786518c4-37e2-4351-9f89-ef9cc21a997a-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-786518c4-37e2-4351-9f89-ef9cc21a997a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-786518c4-37e2-4351-9f89-ef9cc21a997a" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:50 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[36452749-8f71-4b82-b161-dd734e2920bc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:50 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a Nov 02 10:04:50 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:51 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a" returned: 0 in 0.965s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:51 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a Nov 02 10:04:51 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:51 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-786518c4-37e2-4351-9f89-ef9cc21a997a" returned: 0 in 0.482s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-786518c4-37e2-4351-9f89-ef9cc21a997a" released by "delete_volume" :: held 1.600s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:51 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Created reservations ['e463495d-3137-4d50-8ea2-19c1154f8286', '74a94078-0d95-4d37-abc8-cb51c1c19b96', '6c71717b-b46c-464f-a99d-70d3fea81c54', 'e87e2b40-b86a-4562-9e89-b9032b3e2ca8'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:52 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:04:52 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-b6b48bc3-4c43-4283-a379-20848739c21a" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-b6b48bc3-4c43-4283-a379-20848739c21a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Deleting offline snapshot 63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 of volume b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:04:52 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] snapshot_file for this snap is: volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.622s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c37f9-489e-4a1e-be5e-069307e86b08]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Deleted volume successfully. Nov 02 10:04:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d1c73c5c-2428-4d9e-9e95-612bcd881616 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-786518c4-37e2-4351-9f89-ef9cc21a997a-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:53 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 Nov 02 10:04:53 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:53 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794" returned: 0 in 0.642s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b48bc3-4c43-4283-a379-20848739c21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:04:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5446c790-7ea9-4c7c-9c33-f2c6b8e7f3f7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:53 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a Nov 02 10:04:53 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:54 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a" returned: 0 in 0.741s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:54 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 Nov 02 10:04:54 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:54 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794" returned: 0 in 0.429s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:54 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794 Nov 02 10:04:54 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:55 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a.63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794" returned: 0 in 0.426s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794" released by "_delete_snapshot" :: held 2.443s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-b6b48bc3-4c43-4283-a379-20848739c21a" released by "delete_snapshot" :: held 2.496s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:55 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Created reservations ['80509524-a759-4d9a-b16e-0fcebd453136', '2d4471be-7c50-4ec6-bff0-80cbb4f8d88c', 'db3d5330-b1f1-44e0-85d3-2d558e1d22bf', 'd671c93a-54d2-407f-9cc6-3d9646812f3b'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Delete snapshot completed successfully. Nov 02 10:04:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a86b9bbf-f880-4587-a10c-f99aacec9f16 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-63b87c6b-9c4e-4fa5-bbd2-8bdc5f743794-delete_snapshot" released by "delete_snapshot" :: held 2.805s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-b6b48bc3-4c43-4283-a379-20848739c21a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-b6b48bc3-4c43-4283-a379-20848739c21a-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-b6b48bc3-4c43-4283-a379-20848739c21a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:04:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-b6b48bc3-4c43-4283-a379-20848739c21a" acquired by "delete_volume" :: waited 0.044s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:04:56 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1b4e7e-c34b-4305-8301-be7454061380]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:04:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:56 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a Nov 02 10:04:56 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:57 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a" returned: 0 in 0.675s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:57 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a Nov 02 10:04:57 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:57 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b6b48bc3-4c43-4283-a379-20848739c21a" returned: 0 in 0.620s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-b6b48bc3-4c43-4283-a379-20848739c21a" released by "delete_volume" :: held 1.417s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Created reservations ['66340c61-d8b9-463d-bf86-a020443230ec', 'e32cfeb6-526b-4227-90e5-fd1b595e375f', 'e072af21-648a-4818-9196-ebf05058f35b', 'e4192734-deef-4321-82da-abc1556374c3'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:58 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:04:58 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Flow 'volume_create_manager' (e5d2af2a-1ca9-4640-b4a4-5d8c7cd44534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7f1935-349b-4aa1-b874-bea879f65d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:58 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.341s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7f1935-349b-4aa1-b874-bea879f65d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-484810401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2687f13-fdec-49e2-83ae-3c1918f2cff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e271d9e2bcca4376ac9a1eff1d8e1ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:58Z,use_quota=True,user_id='0d0f4cfa05604ae28d704b57c9ac8104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f4b5e0-c70b-449f-a710-6207ec6986f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f4b5e0-c70b-449f-a710-6207ec6986f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f063b5ee-6fc9-46f8-be3f-e69560748924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f063b5ee-6fc9-46f8-be3f-e69560748924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2687f13-fdec-49e2-83ae-3c1918f2cff0', 'volume_name': 'volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10bd6a40-8b1c-4cb2-b241-db826922f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10bd6a40-8b1c-4cb2-b241-db826922f260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225a9da3-433c-4fe6-bb21-4da33d94de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:58 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Volume c2687f13-fdec-49e2-83ae-3c1918f2cff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0', 'volume_size': 1} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-484810401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2687f13-fdec-49e2-83ae-3c1918f2cff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e271d9e2bcca4376ac9a1eff1d8e1ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:58Z,use_quota=True,user_id='0d0f4cfa05604ae28d704b57c9ac8104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Creating volume c2687f13-fdec-49e2-83ae-3c1918f2cff0 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:58 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:58 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Deleted volume successfully. Nov 02 10:04:58 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 1073741824 Nov 02 10:04:58 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8b27d3b4-fa72-4c04-bbf0-8ee8012defae tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-b6b48bc3-4c43-4283-a379-20848739c21a-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:04:59 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 1073741824" returned: 0 in 0.975s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:04:59 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 Nov 02 10:04:59 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (b7a9b4c8-4512-4586-a32a-e635fa88da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e505848e-4b56-4e33-b377-cda48386f944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e505848e-4b56-4e33-b377-cda48386f944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1226471365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06026c8b-cd55-44d8-961a-be3158776684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66911ba9db8e41e5a007f0fab213e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:00Z,use_quota=True,user_id='a5f84b6c5c7f403a9445433867f3bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b572a0ae-9fc1-4a60-9d64-c0a97ed46cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b572a0ae-9fc1-4a60-9d64-c0a97ed46cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03a0616-5b22-46da-89ab-601794cb1e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03a0616-5b22-46da-89ab-601794cb1e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06026c8b-cd55-44d8-961a-be3158776684', 'volume_name': 'volume-06026c8b-cd55-44d8-961a-be3158776684', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c23962-0f79-437e-913e-2da6fb22075d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c23962-0f79-437e-913e-2da6fb22075d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2223a-9de8-48cf-adce-82cb1646076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:04:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Volume 06026c8b-cd55-44d8-961a-be3158776684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06026c8b-cd55-44d8-961a-be3158776684', 'volume_size': 1} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:59 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0" returned: 0 in 0.492s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1226471365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06026c8b-cd55-44d8-961a-be3158776684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66911ba9db8e41e5a007f0fab213e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:00Z,use_quota=True,user_id='a5f84b6c5c7f403a9445433867f3bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Creating volume 06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:04:59 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:04:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225a9da3-433c-4fe6-bb21-4da33d94de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:00 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 1073741824 Nov 02 10:05:00 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f2abaa-880a-44e4-8789-faa1cb5df9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:00 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Volume volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 (c2687f13-fdec-49e2-83ae-3c1918f2cff0): created successfully Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f2abaa-880a-44e4-8789-faa1cb5df9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Flow 'volume_create_manager' (e5d2af2a-1ca9-4640-b4a4-5d8c7cd44534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a6d3181b-4479-4d8c-bffe-183a66fe5b68 tempest-SnapshotMetadataTestJSON-643611788 None] Created volume successfully. Nov 02 10:05:00 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 1073741824" returned: 0 in 0.671s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:00 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 Nov 02 10:05:00 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:00 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684" returned: 0 in 0.251s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.285s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2223a-9de8-48cf-adce-82cb1646076c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06026c8b-cd55-44d8-961a-be3158776684', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c202a179-f829-4836-984e-f933978475ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Creating offline snapshot 02bc1c29-f9f5-49f8-b71d-e0402e815d96 of volume c2687f13-fdec-49e2-83ae-3c1918f2cff0 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:05:00 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Volume volume-06026c8b-cd55-44d8-961a-be3158776684 (06026c8b-cd55-44d8-961a-be3158776684): created successfully Nov 02 10:05:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c202a179-f829-4836-984e-f933978475ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (b7a9b4c8-4512-4586-a32a-e635fa88da4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:01 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[407fb176-532f-48db-8983-83bb98559a6f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:01 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7e1da1a1-a21b-4fe7-b814-cea2bd76b24b tempest-VolumesSnapshotTestJSON-1361891677 None] Created volume successfully. Nov 02 10:05:01 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 Nov 02 10:05:01 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:01 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0" returned: 0 in 0.416s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:01 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 1G Nov 02 10:05:01 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:02 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 1G" returned: 0 in 0.635s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:02 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 Nov 02 10:05:02 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:02 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96" returned: 0 in 0.338s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:02 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 is being set with open permissions: ugo+rw Nov 02 10:05:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:02 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 Nov 02 10:05:02 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:02 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96" returned: 0 in 0.267s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:02 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.info Nov 02 10:05:02 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:02 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.info" returned: 0 in 0.263s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:02 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.info is being set with open permissions: ugo+rw Nov 02 10:05:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:03 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.info Nov 02 10:05:03 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:03 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.info" returned: 0 in 0.262s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.228s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Creating offline snapshot 4b4381b6-82fe-46c5-9a2c-dc64010151f5 of volume 06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:05:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8dabbdfc-75a0-4c8a-abfa-5176f6b7bd2d tempest-SnapshotMetadataTestJSON-643611788 None] Create snapshot completed successfully Nov 02 10:05:03 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e69ce30-ae1b-44d9-bcf7-539cb200e42a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:03 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 Nov 02 10:05:03 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:03 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684" returned: 0 in 0.440s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:03 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 1G Nov 02 10:05:03 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:04 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 1G" returned: 0 in 0.818s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06026c8b-cd55-44d8-961a-be3158776684 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:04 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06026c8b-cd55-44d8-961a-be3158776684 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 Nov 02 10:05:04 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Acquiring lock "cinder-02bc1c29-f9f5-49f8-b71d-e0402e815d96-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-02bc1c29-f9f5-49f8-b71d-e0402e815d96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Acquiring lock "cinder-quobyte-c2687f13-fdec-49e2-83ae-3c1918f2cff0" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-quobyte-c2687f13-fdec-49e2-83ae-3c1918f2cff0" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Acquiring lock "cinder-quobyte-02bc1c29-f9f5-49f8-b71d-e0402e815d96" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-quobyte-02bc1c29-f9f5-49f8-b71d-e0402e815d96" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Deleting offline snapshot 02bc1c29-f9f5-49f8-b71d-e0402e815d96 of volume c2687f13-fdec-49e2-83ae-3c1918f2cff0 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:05:05 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] snapshot_file for this snap is: volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06026c8b-cd55-44d8-961a-be3158776684 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5" returned: 0 in 0.605s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:05 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 is being set with open permissions: ugo+rw Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f43db97-23b4-497b-aff7-d3a48bdc0e60]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:05 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 Nov 02 10:05:05 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:05 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 Nov 02 10:05:05 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Flow 'volume_create_manager' (7a6e5620-641f-420c-b1a0-856e7d22ae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e97f67-cb20-4e10-a1d0-8146ca33440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e97f67-cb20-4e10-a1d0-8146ca33440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1901179723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0f831-8847-423b-8d0c-1bcad13ebc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56519c65cb29418ea2e5a9473cc7eaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:05Z,use_quota=True,user_id='8fd2c29577584672a9fd2fe7c23f0c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfc7f8e-2add-47ba-8919-e6b0cbe7dbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbfc7f8e-2add-47ba-8919-e6b0cbe7dbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9998bcd-9e8b-42b6-9901-5f636d7598d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9998bcd-9e8b-42b6-9901-5f636d7598d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a0f831-8847-423b-8d0c-1bcad13ebc23', 'volume_name': 'volume-81a0f831-8847-423b-8d0c-1bcad13ebc23', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08cfbd0-57bf-4480-b631-b52e84b49cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08cfbd0-57bf-4480-b631-b52e84b49cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5c4c31-fe0e-46d3-8843-fa3acccee60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:05 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Volume 81a0f831-8847-423b-8d0c-1bcad13ebc23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a0f831-8847-423b-8d0c-1bcad13ebc23', 'volume_size': 1} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:05 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5" returned: 0 in 0.389s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:05 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.info Nov 02 10:05:05 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:05 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96" returned: 0 in 0.547s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a1a790-adec-4dfe-80ec-da98af331a3f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:05 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 Nov 02 10:05:05 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:05 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.info" returned: 0 in 0.299s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:05 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.info is being set with open permissions: ugo+rw Nov 02 10:05:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:05 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.info Nov 02 10:05:05 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:06 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.info" returned: 0 in 0.327s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:06 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1901179723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a0f831-8847-423b-8d0c-1bcad13ebc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56519c65cb29418ea2e5a9473cc7eaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:05Z,use_quota=True,user_id='8fd2c29577584672a9fd2fe7c23f0c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Creating volume 81a0f831-8847-423b-8d0c-1bcad13ebc23 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:06 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0" returned: 0 in 0.509s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:06 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 1073741824 Nov 02 10:05:06 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:06 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 Nov 02 10:05:06 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-277f7121-8a40-4460-aa72-e0fb391cb043 tempest-VolumesSnapshotTestJSON-1361891677 None] Create snapshot completed successfully Nov 02 10:05:06 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96" returned: 0 in 0.383s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:06 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96 Nov 02 10:05:06 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:06 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 1073741824" returned: 0 in 0.436s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:06 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 Nov 02 10:05:06 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:06 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0.02bc1c29-f9f5-49f8-b71d-e0402e815d96" returned: 0 in 0.276s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-quobyte-02bc1c29-f9f5-49f8-b71d-e0402e815d96" released by "_delete_snapshot" :: held 1.862s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-quobyte-c2687f13-fdec-49e2-83ae-3c1918f2cff0" released by "delete_snapshot" :: held 1.901s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:07 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23" returned: 0 in 0.293s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5c4c31-fe0e-46d3-8843-fa3acccee60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a0f831-8847-423b-8d0c-1bcad13ebc23', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbcb2fe-de77-472c-a703-598783d7cfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Volume volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 (81a0f831-8847-423b-8d0c-1bcad13ebc23): created successfully Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbcb2fe-de77-472c-a703-598783d7cfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Flow 'volume_create_manager' (7a6e5620-641f-420c-b1a0-856e7d22ae94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Created reservations ['6e351adb-3f4a-48ff-bf87-083be954c3e8', '071df5c7-bdec-4767-9755-1600733ddc54', 'a8aeaef0-f1d6-49f7-87fd-b98639c32d65', 'ecb48a6a-3b4e-4a17-b2b5-8528af7a8849'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-66c1677d-eef2-405a-a4c9-00731ba7dec1 tempest-AttachVolumeTestJSON-12520340 None] Created volume successfully. Nov 02 10:05:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Delete snapshot completed successfully. Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccac1dee-511f-44dc-92cd-22cbbc8af9a4 tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-02bc1c29-f9f5-49f8-b71d-e0402e815d96-delete_snapshot" released by "delete_snapshot" :: held 2.147s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Acquiring lock "cinder-c2687f13-fdec-49e2-83ae-3c1918f2cff0-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-c2687f13-fdec-49e2-83ae-3c1918f2cff0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Acquiring lock "cinder-quobyte-c2687f13-fdec-49e2-83ae-3c1918f2cff0" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-quobyte-c2687f13-fdec-49e2-83ae-3c1918f2cff0" acquired by "delete_volume" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[901c9b00-8ced-4042-b379-f51c05b37829]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:07 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 Nov 02 10:05:07 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:08 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0" returned: 0 in 0.664s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:08 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0 Nov 02 10:05:08 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (e3c1fc87-23f9-403c-aabb-f2b1179c76cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbc34da-afd9-49b0-b651-53246b6e429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbc34da-afd9-49b0-b651-53246b6e429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-687535166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb6d164-6f08-493f-899c-77f3bff8f754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66911ba9db8e41e5a007f0fab213e7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4b4381b6-82fe-46c5-9a2c-dc64010151f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:08Z,use_quota=True,user_id='a5f84b6c5c7f403a9445433867f3bcbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0f316c-04f0-4dbc-b5fc-ada1a5bf39b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0f316c-04f0-4dbc-b5fc-ada1a5bf39b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd998ed-37ae-4f37-a0dc-f80b927241bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd998ed-37ae-4f37-a0dc-f80b927241bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9cb6d164-6f08-493f-899c-77f3bff8f754', 'volume_name': 'volume-9cb6d164-6f08-493f-899c-77f3bff8f754', 'volume_size': 1, 'snapshot_id': '4b4381b6-82fe-46c5-9a2c-dc64010151f5'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7219c81-82db-4f65-9bab-ab5022d1198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7219c81-82db-4f65-9bab-ab5022d1198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897f44d1-5aa0-4526-92ac-21b3d300f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Volume 9cb6d164-6f08-493f-899c-77f3bff8f754: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9cb6d164-6f08-493f-899c-77f3bff8f754', 'volume_size': 1, 'snapshot_id': '4b4381b6-82fe-46c5-9a2c-dc64010151f5'} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-4b4381b6-82fe-46c5-9a2c-dc64010151f5-9cb6d164-6f08-493f-899c-77f3bff8f754" by "_create_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-4b4381b6-82fe-46c5-9a2c-dc64010151f5-9cb6d164-6f08-493f-899c-77f3bff8f754" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Creating volume 9cb6d164-6f08-493f-899c-77f3bff8f754 from snapshot 4b4381b6-82fe-46c5-9a2c-dc64010151f5 {{(pid=86840) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-9cb6d164-6f08-493f-899c-77f3bff8f754" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-9cb6d164-6f08-493f-899c-77f3bff8f754" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] snapshot: 4b4381b6-82fe-46c5-9a2c-dc64010151f5, volume: 9cb6d164-6f08-493f-899c-77f3bff8f754, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:05:08 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c2687f13-fdec-49e2-83ae-3c1918f2cff0" returned: 0 in 0.451s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-quobyte-c2687f13-fdec-49e2-83ae-3c1918f2cff0" released by "delete_volume" :: held 1.260s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4b62e4-e8fe-4196-8b4a-e0f33b3899aa]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-a4cf5299-c36a-4fd5-8fe4-fd50b3166adb req-2c50c3ce-4a4c-470f-ba7a-74aec0b1fc61 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Created reservations ['7484ea5c-dadc-4576-8485-473ededaec42', '70462693-2cdd-4a75-81bc-a864b6d33646', '3c790df4-5e15-4207-b509-cbcfc89ce14c', '2d695faa-0c30-4c90-937c-f7eac64bf5a3'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:08 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 Nov 02 10:05:08 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:08 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:08 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:09 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5" returned: 0 in 0.447s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06026c8b-cd55-44d8-961a-be3158776684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc368182-a15b-41f6-b54b-8c8c0033e096]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:09 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.340s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Deleted volume successfully. Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5fa12a50-ca8e-4535-b030-a54a80f5d6ed tempest-SnapshotMetadataTestJSON-643611788 None] Lock "cinder-c2687f13-fdec-49e2-83ae-3c1918f2cff0-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:09 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 Nov 02 10:05:09 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:09 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684" returned: 0 in 0.471s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:05:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:09 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 Nov 02 10:05:09 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:17 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754" returned: 0 in 7.461s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:05:17 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Converted 1024.00 MB image at 137.22 MB/s Nov 02 10:05:17 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 is being set with open permissions: ugo+rw Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:17 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 Nov 02 10:05:17 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:17 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754" returned: 0 in 0.326s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-9cb6d164-6f08-493f-899c-77f3bff8f754" released by "_copy_volume_from_snapshot" :: held 8.832s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-4b4381b6-82fe-46c5-9a2c-dc64010151f5-9cb6d164-6f08-493f-899c-77f3bff8f754" released by "_create_volume_from_snapshot" :: held 8.944s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.978s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-a4cf5299-c36a-4fd5-8fe4-fd50b3166adb req-2c50c3ce-4a4c-470f-ba7a-74aec0b1fc61 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.786s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-a4cf5299-c36a-4fd5-8fe4-fd50b3166adb req-2c50c3ce-4a4c-470f-ba7a-74aec0b1fc61 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897f44d1-5aa0-4526-92ac-21b3d300f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb6d164-6f08-493f-899c-77f3bff8f754', 'volume_size': 1, 'snapshot_id': '4b4381b6-82fe-46c5-9a2c-dc64010151f5'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df57a348-e717-4e29-bbfe-fb242a564ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:17 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Volume volume-9cb6d164-6f08-493f-899c-77f3bff8f754 (9cb6d164-6f08-493f-899c-77f3bff8f754): created successfully Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df57a348-e717-4e29-bbfe-fb242a564ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Flow 'volume_create_manager' (e3c1fc87-23f9-403c-aabb-f2b1179c76cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-a4cf5299-c36a-4fd5-8fe4-fd50b3166adb req-2c50c3ce-4a4c-470f-ba7a-74aec0b1fc61 tempest-AttachVolumeTestJSON-12520340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-81a0f831-8847-423b-8d0c-1bcad13ebc23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcf720c4-c442-4add-869b-d9334c6d78dc', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:05:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f13b6b97-d9fd-4772-830a-f222f96d5f3c tempest-VolumesSnapshotTestJSON-1361891677 None] Created volume successfully. Nov 02 10:05:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-a4cf5299-c36a-4fd5-8fe4-fd50b3166adb req-2c50c3ce-4a4c-470f-ba7a-74aec0b1fc61 tempest-AttachVolumeTestJSON-12520340 None] attachment_update completed successfully. Nov 02 10:05:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-9cb6d164-6f08-493f-899c-77f3bff8f754-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-9cb6d164-6f08-493f-899c-77f3bff8f754-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-9cb6d164-6f08-493f-899c-77f3bff8f754" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-9cb6d164-6f08-493f-899c-77f3bff8f754" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:18 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896b98a-b95d-41d9-83c2-a6cdb62b9ee6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:18 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 Nov 02 10:05:18 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:18 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754" returned: 0 in 0.485s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:18 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754 Nov 02 10:05:18 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:19 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cb6d164-6f08-493f-899c-77f3bff8f754" returned: 0 in 0.499s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-9cb6d164-6f08-493f-899c-77f3bff8f754" released by "delete_volume" :: held 1.066s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Created reservations ['03715356-22e1-4e4b-93d8-2beab82af9f4', '2901bee6-65aa-4f32-9540-3dfe9b2ec89c', 'f948230b-26cb-4a51-bf16-30f955683d28', '7585391d-827b-4ffb-adb7-35e5953780ad'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:19 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:19 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:19 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.296s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:19 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Deleted volume successfully. Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1b54b4ad-8876-4225-90f2-4b996769b42f tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-9cb6d164-6f08-493f-899c-77f3bff8f754-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-4b4381b6-82fe-46c5-9a2c-dc64010151f5-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-4b4381b6-82fe-46c5-9a2c-dc64010151f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-06026c8b-cd55-44d8-961a-be3158776684" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-06026c8b-cd55-44d8-961a-be3158776684" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-4b4381b6-82fe-46c5-9a2c-dc64010151f5" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:20 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:20 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-4b4381b6-82fe-46c5-9a2c-dc64010151f5" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Deleting offline snapshot 4b4381b6-82fe-46c5-9a2c-dc64010151f5 of volume 06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] snapshot_file for this snap is: volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c3dfde-8d04-4644-aaf9-009969165221]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:21 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 Nov 02 10:05:21 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:21 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.464s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:05:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:05:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:05:21 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5" returned: 0 in 0.549s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06026c8b-cd55-44d8-961a-be3158776684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:21 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2ba369-672a-45da-b5c8-883e4ff4983f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:21 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 Nov 02 10:05:21 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:22 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684" returned: 0 in 0.824s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:22 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 Nov 02 10:05:22 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:23 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5" returned: 0 in 0.902s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:23 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5 Nov 02 10:05:23 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:23 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684.4b4381b6-82fe-46c5-9a2c-dc64010151f5" returned: 0 in 0.534s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-4b4381b6-82fe-46c5-9a2c-dc64010151f5" released by "_delete_snapshot" :: held 3.069s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-06026c8b-cd55-44d8-961a-be3158776684" released by "delete_snapshot" :: held 3.120s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Created reservations ['b3bf59a7-9f91-49a1-8277-fd8787f74fb5', '279128dd-cae9-468b-9fd7-bfa24c20b129', 'a1f62800-e47b-4836-bba8-89b04ae92fc7', '99595441-0aef-4554-acf6-2b8c5b165423'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:24 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Delete snapshot completed successfully. Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-967439ee-5576-47e6-9111-a026a351173e tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-4b4381b6-82fe-46c5-9a2c-dc64010151f5-delete_snapshot" released by "delete_snapshot" :: held 3.480s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Flow 'volume_create_manager' (7b4705a4-0232-4570-ad50-8b230cc96ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9318305c-9e2a-4f94-aac1-d5f8c7d42718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9318305c-9e2a-4f94-aac1-d5f8c7d42718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1971023744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c374a1-8a5c-447a-8ab4-59bf3143c185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87653e32cdc42cbaae2815b6389f8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:24Z,use_quota=True,user_id='ae9548e5e66c44d9a0f81d51001a88b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb6bd5c-4a4a-4b7b-803f-dee96342b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb6bd5c-4a4a-4b7b-803f-dee96342b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228f1a99-430f-429c-af5c-25031b96d6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228f1a99-430f-429c-af5c-25031b96d6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c374a1-8a5c-447a-8ab4-59bf3143c185', 'volume_name': 'volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317f70e7-5af7-4bd7-82ee-4fb4c1db0376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317f70e7-5af7-4bd7-82ee-4fb4c1db0376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7f1fa7-54ae-49f3-b140-32ee6eea170a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:24 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Volume e3c374a1-8a5c-447a-8ab4-59bf3143c185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185', 'volume_size': 1} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1971023744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c374a1-8a5c-447a-8ab4-59bf3143c185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87653e32cdc42cbaae2815b6389f8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:24Z,use_quota=True,user_id='ae9548e5e66c44d9a0f81d51001a88b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Creating volume e3c374a1-8a5c-447a-8ab4-59bf3143c185 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:24 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:05:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:24 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 1073741824 Nov 02 10:05:24 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-06026c8b-cd55-44d8-961a-be3158776684-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-06026c8b-cd55-44d8-961a-be3158776684-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-06026c8b-cd55-44d8-961a-be3158776684" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-06026c8b-cd55-44d8-961a-be3158776684" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:25 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b5cbd1-7d4b-42ed-8dda-02a78f747dcb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:25 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 1073741824" returned: 0 in 1.133s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:25 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 Nov 02 10:05:25 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:25 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 Nov 02 10:05:25 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:26 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684" returned: 0 in 0.664s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:26 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684 Nov 02 10:05:26 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:26 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185" returned: 0 in 0.540s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7f1fa7-54ae-49f3-b140-32ee6eea170a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6020057-e80b-4e60-ae55-f37e82be8a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:26 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Volume volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 (e3c374a1-8a5c-447a-8ab4-59bf3143c185): created successfully Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6020057-e80b-4e60-ae55-f37e82be8a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Flow 'volume_create_manager' (7b4705a4-0232-4570-ad50-8b230cc96ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a543c437-123d-4d81-9115-7eb02b7b3940 tempest-VolumesTransfersV355Test-723887124 None] Created volume successfully. Nov 02 10:05:26 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06026c8b-cd55-44d8-961a-be3158776684" returned: 0 in 0.480s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-06026c8b-cd55-44d8-961a-be3158776684" released by "delete_volume" :: held 1.296s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Created reservations ['d13e26e4-2089-4ea9-be00-4f4c5741eab3', 'c2a163f5-341f-466f-b3ba-ef0b21c109a3', '0a3064e1-47fc-424b-b55b-e931871b2f26', '6cc3399f-e219-4ed2-b71c-98a4adfb8e59'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:26 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:26 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:27 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.333s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:27 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:27 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Deleted volume successfully. Nov 02 10:05:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-da3e040c-afba-4ee8-a2f3-6b9fd21891a2 tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-06026c8b-cd55-44d8-961a-be3158776684-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-54273903-5b21-450e-8496-0ec1f10bf248-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:27 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-7095e855-e25f-4204-b4d3-2698f892b47e tempest-ServerActionsTestOtherA-1016928452 None] Terminate volume connection completed successfully. Nov 02 10:05:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-7095e855-e25f-4204-b4d3-2698f892b47e tempest-ServerActionsTestOtherA-1016928452 None] Deleting attachment 9c240a6b-42a7-47bc-b13d-d9c32f31f07d. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:05:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-54273903-5b21-450e-8496-0ec1f10bf248-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "cinder-quobyte-54273903-5b21-450e-8496-0ec1f10bf248" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-54273903-5b21-450e-8496-0ec1f10bf248" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc4fb93-9518-416f-868c-5942d391817e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "cinder-4434f34b-cf46-4c6b-8d71-5a9c53d6554c-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Lock "cinder-4434f34b-cf46-4c6b-8d71-5a9c53d6554c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "cinder-quobyte-4434f34b-cf46-4c6b-8d71-5a9c53d6554c" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Lock "cinder-quobyte-4434f34b-cf46-4c6b-8d71-5a9c53d6554c" acquired by "delete_volume" :: waited 0.057s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:28 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 Nov 02 10:05:28 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[31afe4a3-da2d-4202-9e68-6e7a30018e62]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:28 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c Nov 02 10:05:28 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:28 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248" returned: 0 in 0.798s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:28 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248 Nov 02 10:05:28 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:29 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2efdd503-eeb2-4d65-ba44-3d7313291692 tempest-VolumesTransfersV355Test-1937152512 None] Transfer volume completed successfully. Nov 02 10:05:29 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c" returned: 0 in 0.681s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:29 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c Nov 02 10:05:29 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:29 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-54273903-5b21-450e-8496-0ec1f10bf248" returned: 0 in 0.402s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-quobyte-54273903-5b21-450e-8496-0ec1f10bf248" released by "delete_volume" :: held 1.347s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Created reservations ['de5fe3df-c406-42ce-a284-d49e57f4a912', '6263cd1c-da01-44ea-ab2d-303d602739ce', '77d592c2-3c26-430c-a143-3101f95d56e0', '3e95fd74-5921-485c-89bd-66ca34128489'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:29 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4434f34b-cf46-4c6b-8d71-5a9c53d6554c" returned: 0 in 0.464s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:29 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Lock "cinder-quobyte-4434f34b-cf46-4c6b-8d71-5a9c53d6554c" released by "delete_volume" :: held 1.261s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:29 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.quota [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Created reservations ['0f89a8f5-1780-49a8-9636-3b95517bc65b', '3f6f1f70-f861-40aa-acb9-073e2e885c30', '9d2e4bff-9520-44f2-9c94-ea724c53c825', '5f7c9b4f-fb1a-4648-b046-5ec721c1a8f0'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "cinder-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Lock "cinder-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:29 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:29 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "cinder-quobyte-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Lock "cinder-quobyte-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5" acquired by "delete_volume" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d82cfa-067a-4165-a1b6-b5b89c8d59b3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:30 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.497s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:30 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Deleted volume successfully. Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6c25738e-e262-4934-8218-ef914e80b32b tempest-VolumesSnapshotTestJSON-1361891677 None] Lock "cinder-54273903-5b21-450e-8496-0ec1f10bf248-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:30 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 Nov 02 10:05:30 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Acquiring lock "cinder-e3c374a1-8a5c-447a-8ab4-59bf3143c185-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Lock "cinder-e3c374a1-8a5c-447a-8ab4-59bf3143c185-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:30 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.427s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG cinder.manager [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:30 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Deleted volume successfully. Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Acquiring lock "cinder-quobyte-e3c374a1-8a5c-447a-8ab4-59bf3143c185" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-022259cb-8a25-488f-9999-c6ff17a3aebc req-699bd7fe-bdc2-4f93-bbf3-3da0525d83a4 tempest-ServerActionsTestOtherA-1016928452 None] Lock "cinder-4434f34b-cf46-4c6b-8d71-5a9c53d6554c-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Lock "cinder-quobyte-e3c374a1-8a5c-447a-8ab4-59bf3143c185" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f5cfc1-7599-4527-ba9f-271a272fdce7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:30 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 Nov 02 10:05:30 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:30 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5" returned: 0 in 0.603s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:30 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5 Nov 02 10:05:30 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:30 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185" returned: 0 in 0.426s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:30 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185 Nov 02 10:05:30 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:31 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5" returned: 0 in 0.386s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Lock "cinder-quobyte-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5" released by "delete_volume" :: held 1.048s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Created reservations ['0e6b51fd-6806-4be4-a87d-3085f3417106', '804df31b-f2a1-491c-b459-93eeb1c428e8', 'a8e994d1-525e-464e-8638-e85e8d56bd20', 'bb36cef6-0f19-49cf-91fa-cc35e3092c6f'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:31 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3c374a1-8a5c-447a-8ab4-59bf3143c185" returned: 0 in 0.392s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:31 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:31 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Lock "cinder-quobyte-e3c374a1-8a5c-447a-8ab4-59bf3143c185" released by "delete_volume" :: held 0.876s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Created reservations ['e7c885c6-ae1e-4cf0-9a0e-0229ffa9deb8', '3ed37b73-5117-447c-97f1-8116df73e893', '63243c4a-21be-4138-99b2-fe87f7ca7746', '750418f3-4064-4b4b-ad5b-d3683dcb93a2'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:31 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:31 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:31 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.373s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Deleted volume successfully. Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99606a3b-10c0-43a8-a130-a263ecf6d34a tempest-ServerActionsTestOtherA-1016928452 None] Lock "cinder-0ed0bdd6-f4a5-4547-a18f-fac528ab01b5-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:31 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.297s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Deleted volume successfully. Nov 02 10:05:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ca74dae-8e62-4a3a-8fa7-04d6c3206619 tempest-VolumesTransfersV355Test-1550769942 None] Lock "cinder-e3c374a1-8a5c-447a-8ab4-59bf3143c185-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Flow 'volume_create_manager' (66302ea2-fc33-4bec-b253-f7c830ad94d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e638b09c-4cb1-47a5-9259-7fe8cbbd692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e638b09c-4cb1-47a5-9259-7fe8cbbd692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405382196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db50be0e-95cb-4886-998c-9f31cdff584f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87653e32cdc42cbaae2815b6389f8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:33Z,use_quota=True,user_id='ae9548e5e66c44d9a0f81d51001a88b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85657f39-4467-4b22-b211-ecfff0340b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85657f39-4467-4b22-b211-ecfff0340b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df2a254-7485-4af0-b9e9-040f73256189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df2a254-7485-4af0-b9e9-040f73256189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db50be0e-95cb-4886-998c-9f31cdff584f', 'volume_name': 'volume-db50be0e-95cb-4886-998c-9f31cdff584f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fd2ee1-059b-46b1-a796-a6a4feef69a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fd2ee1-059b-46b1-a796-a6a4feef69a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00045923-06a6-4b22-8df8-ec915d4fc280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:33 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Volume db50be0e-95cb-4886-998c-9f31cdff584f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db50be0e-95cb-4886-998c-9f31cdff584f', 'volume_size': 1} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405382196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db50be0e-95cb-4886-998c-9f31cdff584f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87653e32cdc42cbaae2815b6389f8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:33Z,use_quota=True,user_id='ae9548e5e66c44d9a0f81d51001a88b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Creating volume db50be0e-95cb-4886-998c-9f31cdff584f {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:33 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:05:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:33 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f 1073741824 Nov 02 10:05:33 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:34 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f 1073741824" returned: 0 in 0.535s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:34 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f Nov 02 10:05:34 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:34 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f" returned: 0 in 0.382s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00045923-06a6-4b22-8df8-ec915d4fc280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db50be0e-95cb-4886-998c-9f31cdff584f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d835e498-1a5b-4650-b3c8-9f86af62e26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:34 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Volume volume-db50be0e-95cb-4886-998c-9f31cdff584f (db50be0e-95cb-4886-998c-9f31cdff584f): created successfully Nov 02 10:05:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d835e498-1a5b-4650-b3c8-9f86af62e26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Flow 'volume_create_manager' (66302ea2-fc33-4bec-b253-f7c830ad94d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-20dfaa9d-96fd-43f8-a88c-3ccb868cd92c tempest-VolumesTransfersV355Test-723887124 None] Created volume successfully. Nov 02 10:05:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Acquiring lock "cinder-db50be0e-95cb-4886-998c-9f31cdff584f-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Lock "cinder-db50be0e-95cb-4886-998c-9f31cdff584f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Acquiring lock "cinder-quobyte-db50be0e-95cb-4886-998c-9f31cdff584f" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Lock "cinder-quobyte-db50be0e-95cb-4886-998c-9f31cdff584f" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:36 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a592084-fa37-4a1e-8e21-5321f7c38d47]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:36 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f Nov 02 10:05:36 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:36 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f" returned: 0 in 0.494s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:36 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f Nov 02 10:05:36 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:37 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db50be0e-95cb-4886-998c-9f31cdff584f" returned: 0 in 0.366s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Lock "cinder-quobyte-db50be0e-95cb-4886-998c-9f31cdff584f" released by "delete_volume" :: held 0.938s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Created reservations ['1cbef276-38d7-44b4-98c3-fcfca5f62844', '2d964612-4ac9-4f56-b78e-205b3815b686', 'ff9ef67a-c9a9-4bb5-957a-6e043fc15ced', '5ae4030f-9cb0-4456-83ed-57ec79261ca8'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:37 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:37 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:37 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.342s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:37 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Deleted volume successfully. Nov 02 10:05:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32c9d31c-e54e-4bb7-a673-58541ad8a7e3 tempest-VolumesTransfersV355Test-1550769942 None] Lock "cinder-db50be0e-95cb-4886-998c-9f31cdff584f-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Flow 'volume_create_manager' (e4d7d195-dadc-4934-ab9e-44679ecff4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0940dceb-5ba8-4e6a-a376-d0748184378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0940dceb-5ba8-4e6a-a376-d0748184378e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-918884898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23620b3c-543a-4482-a60b-d7c0f7cf5b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bac9a3e538e49e4b9b860cb3924e275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:42Z,use_quota=True,user_id='88598a47743f4cc3b5d1df3e3f1ae095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ef9f52-df38-410f-9d6d-77a7fc6ae16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ef9f52-df38-410f-9d6d-77a7fc6ae16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f25ea1-e045-4684-90bc-11e2ed47a6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f25ea1-e045-4684-90bc-11e2ed47a6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23620b3c-543a-4482-a60b-d7c0f7cf5b0d', 'volume_name': 'volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d', 'volume_size': 2}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9016778c-08f1-43f1-80d5-104007ea80cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9016778c-08f1-43f1-80d5-104007ea80cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24d12d7-f1b9-4b1c-bbf0-be4f748495aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:41 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Volume 23620b3c-543a-4482-a60b-d7c0f7cf5b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d', 'volume_size': 2} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-918884898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23620b3c-543a-4482-a60b-d7c0f7cf5b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bac9a3e538e49e4b9b860cb3924e275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:42Z,use_quota=True,user_id='88598a47743f4cc3b5d1df3e3f1ae095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Creating volume 23620b3c-543a-4482-a60b-d7c0f7cf5b0d {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:41 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:05:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d 2147483648 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:41 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d 2147483648 Nov 02 10:05:41 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:42 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d 2147483648" returned: 0 in 0.716s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:42 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d Nov 02 10:05:42 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:42 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" returned: 0 in 0.374s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24d12d7-f1b9-4b1c-bbf0-be4f748495aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d', 'volume_size': 2}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921a6df1-73a4-446e-a295-caf410ae68bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:43 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Volume volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d (23620b3c-543a-4482-a60b-d7c0f7cf5b0d): created successfully Nov 02 10:05:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921a6df1-73a4-446e-a295-caf410ae68bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Flow 'volume_create_manager' (e4d7d195-dadc-4934-ab9e-44679ecff4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:43 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bddbf491-9ee1-4fd0-bd44-073654f9d8ce tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Created volume successfully. Nov 02 10:05:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Creating offline snapshot 41f29a50-8a7b-44f0-8f68-6ee11af38aa7 of volume 23620b3c-543a-4482-a60b-d7c0f7cf5b0d {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:05:44 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c992dbc2-c6d5-4a29-9433-71ebfe012679]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:44 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d Nov 02 10:05:44 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:44 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" returned: 0 in 0.556s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 2G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:44 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 2G Nov 02 10:05:44 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:45 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 2G" returned: 0 in 0.575s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:45 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 Nov 02 10:05:45 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:45 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7" returned: 0 in 0.363s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:45 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 is being set with open permissions: ugo+rw Nov 02 10:05:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:45 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 Nov 02 10:05:45 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:45 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7" returned: 0 in 0.321s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:46 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.info Nov 02 10:05:46 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:46 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.info" returned: 0 in 0.347s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:46 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.info is being set with open permissions: ugo+rw Nov 02 10:05:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:46 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.info Nov 02 10:05:46 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:46 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.info" returned: 0 in 0.342s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:46 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=102,cinder:UPDATE=129,cinder:INSERT=29,cinder:DELETE=11 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:05:46 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d884b514-1122-4ce5-b466-d1cf3342a91d tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Create snapshot completed successfully Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Acquiring lock "cinder-41f29a50-8a7b-44f0-8f68-6ee11af38aa7-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-41f29a50-8a7b-44f0-8f68-6ee11af38aa7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Acquiring lock "cinder-quobyte-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-quobyte-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Acquiring lock "cinder-quobyte-41f29a50-8a7b-44f0-8f68-6ee11af38aa7" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-quobyte-41f29a50-8a7b-44f0-8f68-6ee11af38aa7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Deleting offline snapshot 41f29a50-8a7b-44f0-8f68-6ee11af38aa7 of volume 23620b3c-543a-4482-a60b-d7c0f7cf5b0d {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] snapshot_file for this snap is: volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f45afa3-ed03-4c50-bfb4-b43ff3f7df40]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:47 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 Nov 02 10:05:47 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Flow 'volume_create_manager' (40763733-d6af-4ac7-a410-66e2e9762fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f76d4b6-5a46-46bd-a801-04144fd960cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f76d4b6-5a46-46bd-a801-04144fd960cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-258280053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1825276-3837-466d-9b76-6ca2f9630d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9953a607548d453385e89e763a50af87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:48Z,use_quota=True,user_id='4f2cc943450942de90aa3a400de39f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce6b7db-bc2a-4c6b-bed5-b05a754f5b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce6b7db-bc2a-4c6b-bed5-b05a754f5b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac1bd54-d9a1-4b19-b906-aa401da398e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac1bd54-d9a1-4b19-b906-aa401da398e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1825276-3837-466d-9b76-6ca2f9630d0d', 'volume_name': 'volume-e1825276-3837-466d-9b76-6ca2f9630d0d', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1230f72d-0c25-416d-ae95-b455ded94b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1230f72d-0c25-416d-ae95-b455ded94b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043245ac-ca6b-43a8-a5a9-b718f223d828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Volume e1825276-3837-466d-9b76-6ca2f9630d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1825276-3837-466d-9b76-6ca2f9630d0d', 'volume_size': 1} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-258280053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1825276-3837-466d-9b76-6ca2f9630d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9953a607548d453385e89e763a50af87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:48Z,use_quota=True,user_id='4f2cc943450942de90aa3a400de39f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Creating volume e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:05:47 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:05:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:47 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d 1073741824 Nov 02 10:05:47 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:48 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7" returned: 0 in 0.443s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f0c624-2be6-47ef-aefd-feb0c54cf931]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:48 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d Nov 02 10:05:48 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:48 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d 1073741824" returned: 0 in 0.605s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:48 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d Nov 02 10:05:48 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:48 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" returned: 0 in 0.552s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:48 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 Nov 02 10:05:48 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:48 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d" returned: 0 in 0.367s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043245ac-ca6b-43a8-a5a9-b718f223d828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1825276-3837-466d-9b76-6ca2f9630d0d', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10fb535-3138-42c1-bc33-497c40a5ab0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:48 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Volume volume-e1825276-3837-466d-9b76-6ca2f9630d0d (e1825276-3837-466d-9b76-6ca2f9630d0d): created successfully Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10fb535-3138-42c1-bc33-497c40a5ab0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Flow 'volume_create_manager' (40763733-d6af-4ac7-a410-66e2e9762fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3b118801-aeaf-48b0-a0ac-1cb0480dfbc0 tempest-VolumesCloneTest-374979780 None] Created volume successfully. Nov 02 10:05:49 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7" returned: 0 in 0.456s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:49 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7 Nov 02 10:05:49 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:49 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d.41f29a50-8a7b-44f0-8f68-6ee11af38aa7" returned: 0 in 0.299s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-quobyte-41f29a50-8a7b-44f0-8f68-6ee11af38aa7" released by "_delete_snapshot" :: held 1.918s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-quobyte-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" released by "delete_snapshot" :: held 1.946s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=117,cinder:UPDATE=129,cinder:INSERT=35,cinder:DELETE=11 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Created reservations ['aeba759b-ada8-4b21-8e40-8b15754e1034', '16dcf4b4-abb7-42d4-9da9-60f36567ab93', 'cc769e46-7b06-443a-b8d6-2cfc38b7cebf', '2fa1612c-3c95-4714-b7ac-24c455324a28'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Delete snapshot completed successfully. Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3759f672-b4a5-4286-86fa-a38ca7176fb8 tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-41f29a50-8a7b-44f0-8f68-6ee11af38aa7-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Acquiring lock "cinder-23620b3c-543a-4482-a60b-d7c0f7cf5b0d-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-23620b3c-543a-4482-a60b-d7c0f7cf5b0d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Acquiring lock "cinder-quobyte-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-quobyte-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5816962-2d9e-4492-9c32-85f905867846]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:50 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d Nov 02 10:05:50 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Flow 'volume_create_manager' (4f58588f-9dbe-475c-a1e8-325bc657c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb61e3e-0bd4-4cf2-9ad3-e2c5289ab36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:50 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" returned: 0 in 0.491s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:50 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d Nov 02 10:05:50 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb61e3e-0bd4-4cf2-9ad3-e2c5289ab36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2063260767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6d17a5-62d4-4293-bf57-0e0ee6a69939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9953a607548d453385e89e763a50af87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e1825276-3837-466d-9b76-6ca2f9630d0d,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:50Z,use_quota=True,user_id='4f2cc943450942de90aa3a400de39f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137b1052-4f4e-44ae-b8dc-9ca7153140ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137b1052-4f4e-44ae-b8dc-9ca7153140ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c191bb7a-73c0-406f-b699-a3c59cbe9c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c191bb7a-73c0-406f-b699-a3c59cbe9c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9d6d17a5-62d4-4293-bf57-0e0ee6a69939', 'volume_name': 'volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939', 'volume_size': 2, 'source_volid': 'e1825276-3837-466d-9b76-6ca2f9630d0d', 'source_volstatus': 'available'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0473ecb-9819-4d84-92cd-c89011e03148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0473ecb-9819-4d84-92cd-c89011e03148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82ddc45-a6b4-4033-a584-02e634cad263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:05:50 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Volume 9d6d17a5-62d4-4293-bf57-0e0ee6a69939: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939', 'volume_size': 2, 'source_volid': 'e1825276-3837-466d-9b76-6ca2f9630d0d', 'source_volstatus': 'available'} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:50 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Cloning volume e1825276-3837-466d-9b76-6ca2f9630d0d to volume 9d6d17a5-62d4-4293-bf57-0e0ee6a69939 Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Creating offline snapshot 4c09933a-a14c-4e2f-b28f-115de0335049 of volume e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83cb523-d0ad-4140-a0f0-a3fb68e42c63]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:50 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" returned: 0 in 0.265s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-quobyte-23620b3c-543a-4482-a60b-d7c0f7cf5b0d" released by "delete_volume" :: held 0.866s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:50 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d Nov 02 10:05:50 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:50 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Created reservations ['a73f6d1e-b129-471c-be88-7eb8a28d0da5', '4c937337-88fe-4ba6-9546-c30da2591896', '19bb20f3-3892-4991-bef2-138a2f8e743f', 'a1fb6d5f-a10f-46d9-acdb-966476332470'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:51 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:05:51 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:51 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d" returned: 0 in 0.596s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:51 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 1G Nov 02 10:05:51 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:51 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.370s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:05:51 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Deleted volume successfully. Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f7431056-cc9e-4dfd-a1cf-25ae0b6f34fd tempest-VolumesSnapshotNegativeTestJSON-11073054 None] Lock "cinder-23620b3c-543a-4482-a60b-d7c0f7cf5b0d-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:05:51 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 1G" returned: 0 in 0.516s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1825276-3837-466d-9b76-6ca2f9630d0d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:51 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1825276-3837-466d-9b76-6ca2f9630d0d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 Nov 02 10:05:51 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:52 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1825276-3837-466d-9b76-6ca2f9630d0d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:52 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 is being set with open permissions: ugo+rw Nov 02 10:05:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:52 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 Nov 02 10:05:52 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:52 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049" returned: 0 in 0.512s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:52 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.info Nov 02 10:05:52 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:53 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.info" returned: 0 in 0.436s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:53 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.info is being set with open permissions: ugo+rw Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:53 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.info Nov 02 10:05:53 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:53 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.info" returned: 0 in 0.369s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Acquiring lock "cinder-quobyte-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Lock "cinder-quobyte-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] snapshot: 4c09933a-a14c-4e2f-b28f-115de0335049, volume: 9d6d17a5-62d4-4293-bf57-0e0ee6a69939, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[351e617a-a27b-4518-9b37-2274c648434c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:53 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 Nov 02 10:05:53 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:54 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049" returned: 0 in 0.497s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1825276-3837-466d-9b76-6ca2f9630d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:05:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b02c756-7443-40dc-a742-64a7c52e2226]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:05:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:54 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d Nov 02 10:05:54 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:05:54 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Nov 02 10:05:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d" returned: 0 in 0.527s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:05:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:05:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:05:54 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:05:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:05:54 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 Nov 02 10:05:54 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:02 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:06:02 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=17,cinder:SELECT=20,cinder:INSERT=6 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:06:04 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" returned: 0 in 9.325s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:06:04 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Converted 1024.00 MB image at 109.76 MB/s Nov 02 10:06:04 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 is being set with open permissions: ugo+rw Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:04 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 Nov 02 10:06:04 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:04 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" returned: 0 in 0.324s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Lock "cinder-quobyte-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" released by "_copy_volume_from_snapshot" :: held 10.795s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Acquiring lock "cinder-quobyte-4c09933a-a14c-4e2f-b28f-115de0335049" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Lock "cinder-quobyte-4c09933a-a14c-4e2f-b28f-115de0335049" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Deleting offline snapshot 4c09933a-a14c-4e2f-b28f-115de0335049 of volume e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] snapshot_file for this snap is: volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8cb5b4-7d03-4396-bb1c-d73070cb4f78]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:04 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 Nov 02 10:06:04 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:05 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049" returned: 0 in 0.463s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1825276-3837-466d-9b76-6ca2f9630d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:06:05 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede23d7f-ef08-46f2-80fb-33a759da2c1b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:05 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d Nov 02 10:06:05 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:05 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d" returned: 0 in 0.600s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:05 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 Nov 02 10:06:05 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:06 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049" returned: 0 in 0.520s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:06 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049 Nov 02 10:06:06 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:06 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d.4c09933a-a14c-4e2f-b28f-115de0335049" returned: 0 in 0.301s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Lock "cinder-quobyte-4c09933a-a14c-4e2f-b28f-115de0335049" released by "_delete_snapshot" :: held 2.029s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.948s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82ddc45-a6b4-4033-a584-02e634cad263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939', 'volume_size': 2, 'source_volid': 'e1825276-3837-466d-9b76-6ca2f9630d0d', 'source_volstatus': 'available'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78e764f-b2f4-4c46-818a-336d5671a172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:06 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Volume volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 (9d6d17a5-62d4-4293-bf57-0e0ee6a69939): created successfully Nov 02 10:06:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78e764f-b2f4-4c46-818a-336d5671a172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Flow 'volume_create_manager' (4f58588f-9dbe-475c-a1e8-325bc657c504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d26b5929-5647-4f61-9298-0bc7c0755d71 tempest-VolumesCloneTest-374979780 None] Created volume successfully. Nov 02 10:06:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Acquiring lock "cinder-9d6d17a5-62d4-4293-bf57-0e0ee6a69939-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Lock "cinder-9d6d17a5-62d4-4293-bf57-0e0ee6a69939-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Acquiring lock "cinder-quobyte-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Lock "cinder-quobyte-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:07 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4637282e-899b-4b85-af5a-fc8eb5878f0f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:08 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 Nov 02 10:06:08 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:08 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" returned: 0 in 0.549s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:08 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939 Nov 02 10:06:08 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:08 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" returned: 0 in 0.367s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Lock "cinder-quobyte-9d6d17a5-62d4-4293-bf57-0e0ee6a69939" released by "delete_volume" :: held 0.987s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:08 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Created reservations ['20161768-4414-4b7c-ac2b-2153040aaaf6', 'bde7481d-d6f5-4ed8-9d2c-5d11f0201bb7', '74996ae1-2d05-452c-a32c-3bf3adcd17a2', 'bae55c16-5618-42ad-ad2c-d7a5e0c49968'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:09 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:06:09 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:09 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.430s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:09 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Deleted volume successfully. Nov 02 10:06:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7326c56-88bc-4168-bbdc-45581a2efedb tempest-VolumesCloneTest-374979780 None] Lock "cinder-9d6d17a5-62d4-4293-bf57-0e0ee6a69939-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Acquiring lock "cinder-e1825276-3837-466d-9b76-6ca2f9630d0d-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Lock "cinder-e1825276-3837-466d-9b76-6ca2f9630d0d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Acquiring lock "cinder-quobyte-e1825276-3837-466d-9b76-6ca2f9630d0d" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Lock "cinder-quobyte-e1825276-3837-466d-9b76-6ca2f9630d0d" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:10 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1507f2-7420-44ca-b57e-12d12b6f9ae7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:10 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d Nov 02 10:06:10 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:10 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d" returned: 0 in 0.488s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:10 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d Nov 02 10:06:10 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:11 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e1825276-3837-466d-9b76-6ca2f9630d0d" returned: 0 in 0.287s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Lock "cinder-quobyte-e1825276-3837-466d-9b76-6ca2f9630d0d" released by "delete_volume" :: held 0.888s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Created reservations ['19caea79-9e04-4f06-b53c-3eb1c0046e05', 'feec28d1-8705-4baa-91a9-ac9d26ea8b74', 'e3e50150-fab2-41ca-9515-473ca31a5636', 'fdb28b93-e862-4845-8a2d-3915545dc319'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:11 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:06:11 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:11 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.367s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:11 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Deleted volume successfully. Nov 02 10:06:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c13fe637-e0e0-4379-acc8-ad868ea0fd56 tempest-VolumesCloneTest-374979780 None] Lock "cinder-e1825276-3837-466d-9b76-6ca2f9630d0d-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (d7f1481d-fe25-460c-ad90-84fdf5b5e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b1c3a5-8293-4cef-b366-f2d55b3cf463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b1c3a5-8293-4cef-b366-f2d55b3cf463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-484945682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e527798-79f1-45fe-b5d7-6d64e318e702,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:18Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8534c30d-d861-49f4-b04c-ee02cdc54d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8534c30d-d861-49f4-b04c-ee02cdc54d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5058c55-69b8-4328-a5c8-61871b84a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5058c55-69b8-4328-a5c8-61871b84a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e527798-79f1-45fe-b5d7-6d64e318e702', 'volume_name': 'volume-3e527798-79f1-45fe-b5d7-6d64e318e702', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8374c44-1d18-449d-8a29-49509304c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8374c44-1d18-449d-8a29-49509304c781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6804939f-a6a9-41e1-9f86-cdb2969215b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:18 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Volume 3e527798-79f1-45fe-b5d7-6d64e318e702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e527798-79f1-45fe-b5d7-6d64e318e702', 'volume_size': 1} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-484945682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e527798-79f1-45fe-b5d7-6d64e318e702,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:18Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Creating volume 3e527798-79f1-45fe-b5d7-6d64e318e702 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:18 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:06:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:18 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702 1073741824 Nov 02 10:06:18 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:19 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702 1073741824" returned: 0 in 0.896s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:19 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702 Nov 02 10:06:19 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:19 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702" returned: 0 in 0.472s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6804939f-a6a9-41e1-9f86-cdb2969215b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e527798-79f1-45fe-b5d7-6d64e318e702', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7545fe5c-3d36-4486-876e-8e47c05f3a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:19 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Volume volume-3e527798-79f1-45fe-b5d7-6d64e318e702 (3e527798-79f1-45fe-b5d7-6d64e318e702): created successfully Nov 02 10:06:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7545fe5c-3d36-4486-876e-8e47c05f3a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (d7f1481d-fe25-460c-ad90-84fdf5b5e471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4bbb9e51-1045-446b-8453-95de2ad32ebb tempest-VolumesGetTest-254331239 None] Created volume successfully. Nov 02 10:06:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:06:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:20 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:06:20 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:21 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.486s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (17713b0b-0609-4f32-9e69-88a5bec20e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba54547-fa10-4285-b559-75945686e24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba54547-fa10-4285-b559-75945686e24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390316399',display_name='tempest-VolumesGetTest-Volume-560361658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:21Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2707cfb7-07aa-4f49-bdb7-a6c5c05d48e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2707cfb7-07aa-4f49-bdb7-a6c5c05d48e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bd6b91-e577-411c-80a1-36429e84e276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bd6b91-e577-411c-80a1-36429e84e276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c', 'volume_name': 'volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b58ad3f-a23b-4c52-8e48-6e02dcd35281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b58ad3f-a23b-4c52-8e48-6e02dcd35281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee79420c-5684-4739-b7ef-2288e35bf82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Volume 2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c', 'volume_size': 1} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390316399',display_name='tempest-VolumesGetTest-Volume-560361658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:21Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Creating volume 2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:21 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:06:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:21 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c 1073741824 Nov 02 10:06:21 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:22 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c 1073741824" returned: 0 in 0.711s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:22 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c Nov 02 10:06:22 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:22 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c" returned: 0 in 0.334s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee79420c-5684-4739-b7ef-2288e35bf82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a2e038-665b-40be-b1be-8cdadfc2f009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:22 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Volume volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c (2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c): created successfully Nov 02 10:06:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a2e038-665b-40be-b1be-8cdadfc2f009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (17713b0b-0609-4f32-9e69-88a5bec20e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:22 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f1c544b3-4284-41ea-90c3-3940a6a6437e tempest-VolumesGetTest-254331239 None] Created volume successfully. Nov 02 10:06:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Lock "cinder-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-quobyte-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e9b80-b72f-4f89-816f-94f2eac61b78]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:24 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c Nov 02 10:06:24 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:24 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c" returned: 0 in 0.483s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:24 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c Nov 02 10:06:24 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:24 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c" returned: 0 in 0.325s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c" released by "delete_volume" :: held 0.893s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Created reservations ['75f87e6d-d225-40a3-a9c5-920f265df36f', '9dc63bff-b9af-4d3c-ab0b-8c4ce93fee13', 'cf3a3196-27a2-4443-adbd-b40b23bf497a', '131f372e-6151-4b1e-927a-1dfbdf001d4e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:25 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:06:25 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-3e527798-79f1-45fe-b5d7-6d64e318e702-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Lock "cinder-3e527798-79f1-45fe-b5d7-6d64e318e702-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-quobyte-3e527798-79f1-45fe-b5d7-6d64e318e702" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-3e527798-79f1-45fe-b5d7-6d64e318e702" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00ee4b-58eb-41b7-a75f-3376af465c7f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:25 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.568s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Deleted volume successfully. Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-99c7ea9d-a4a3-4706-959f-56d5d151b81f tempest-VolumesGetTest-254331239 None] Lock "cinder-2fddc21e-bbf5-46e0-a9a7-c6ec4522a25c-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:25 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702 Nov 02 10:06:25 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:25 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702" returned: 0 in 0.521s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:26 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702 Nov 02 10:06:26 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:26 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-3e527798-79f1-45fe-b5d7-6d64e318e702" returned: 0 in 0.334s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-3e527798-79f1-45fe-b5d7-6d64e318e702" released by "delete_volume" :: held 0.925s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Created reservations ['a6ea42a9-e7e6-46f4-b848-5bee232ee5be', '6d3c05bd-d0fe-46b2-be1d-6bc49f34fc8b', '24bfd2a7-04ea-45d9-8f01-622d8928586f', '839c8d34-c47b-4230-8809-79ead1eda5fe'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:26 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:06:26 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:26 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.349s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Deleted volume successfully. Nov 02 10:06:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7c54ef15-3245-43c8-9580-62f3314cf71d tempest-VolumesGetTest-254331239 None] Lock "cinder-3e527798-79f1-45fe-b5d7-6d64e318e702-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (e101bb94-3445-40d1-bc09-cad9cc4e449c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bea829-e00f-45fc-890b-ad1bfd9d805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bea829-e00f-45fc-890b-ad1bfd9d805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-581263265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:28Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120eb70a-1bd5-4763-9017-e48733c82a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120eb70a-1bd5-4763-9017-e48733c82a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3eed136-e971-491a-bcba-c8d25aeed67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3eed136-e971-491a-bcba-c8d25aeed67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e', 'volume_name': 'volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ef2859-6c5f-49ed-85b4-11b38a8310c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ef2859-6c5f-49ed-85b4-11b38a8310c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252f6a78-fb55-4c19-b183-e778cd6236e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:28 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Volume 40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e', 'volume_size': 1} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-581263265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:28Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Creating volume 40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:28 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:06:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:28 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e 1073741824 Nov 02 10:06:28 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:29 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e 1073741824" returned: 0 in 0.698s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:29 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e Nov 02 10:06:29 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:29 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e" returned: 0 in 0.320s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252f6a78-fb55-4c19-b183-e778cd6236e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af39fc17-6aa9-4a83-87d6-d773b4209ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:29 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Volume volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e (40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e): created successfully Nov 02 10:06:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af39fc17-6aa9-4a83-87d6-d773b4209ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (e101bb94-3445-40d1-bc09-cad9cc4e449c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:29 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-28b3432b-897f-41ca-a2ff-2ca380591272 tempest-VolumesGetTest-254331239 None] Created volume successfully. Nov 02 10:06:30 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (53d19409-b9ee-43c4-9e77-7e5dd7f9210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b66f6e-cb3c-494c-b2c9-0d37978fee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b66f6e-cb3c-494c-b2c9-0d37978fee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1299122152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2c37c5-4d7a-45e9-9a79-45261382c9d5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:31Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d5e8eb-8557-4b6e-9d27-b0c7474d6b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d5e8eb-8557-4b6e-9d27-b0c7474d6b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063685f1-0a1e-4bc4-a92e-e9fc94edbaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063685f1-0a1e-4bc4-a92e-e9fc94edbaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ef2c37c5-4d7a-45e9-9a79-45261382c9d5', 'volume_name': 'volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5', 'volume_size': 1, 'source_volid': '40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e', 'source_volstatus': 'available'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c58114-c220-4afe-aabe-a6bf8c8362e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c58114-c220-4afe-aabe-a6bf8c8362e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4308e1d0-d1ff-4b78-916b-cb832fa0b456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:31 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Volume ef2c37c5-4d7a-45e9-9a79-45261382c9d5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5', 'volume_size': 1, 'source_volid': '40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e', 'source_volstatus': 'available'} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:31 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Cloning volume 40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e to volume ef2c37c5-4d7a-45e9-9a79-45261382c9d5 Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Creating offline snapshot faecef57-756b-4e04-8e75-62e6b4117b57 of volume 40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2960f461-5e7e-4dc9-bdeb-bc5f7569c843]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:31 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e Nov 02 10:06:31 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:31 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e" returned: 0 in 0.421s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:31 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 1G Nov 02 10:06:31 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:32 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 1G" returned: 0 in 0.549s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:32 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 Nov 02 10:06:32 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:32 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57" returned: 0 in 0.353s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:32 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 is being set with open permissions: ugo+rw Nov 02 10:06:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:32 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 Nov 02 10:06:32 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:33 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57" returned: 0 in 0.348s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:33 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.info Nov 02 10:06:33 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:33 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.info" returned: 0 in 0.297s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:33 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.info is being set with open permissions: ugo+rw Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:33 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.info Nov 02 10:06:33 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:33 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.info" returned: 0 in 0.267s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-quobyte-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] snapshot: faecef57-756b-4e04-8e75-62e6b4117b57, volume: ef2c37c5-4d7a-45e9-9a79-45261382c9d5, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5473007e-6c1d-45c0-91cb-87f281339087]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:33 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 Nov 02 10:06:33 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:34 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57" returned: 0 in 0.382s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:06:34 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a8f43c-fbfe-409f-a1eb-4ab9fec47b05]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:34 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e Nov 02 10:06:34 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:34 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e" returned: 0 in 0.394s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:06:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:06:34 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:06:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:34 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 Nov 02 10:06:34 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Flow 'volume_create_manager' (10da0251-b73e-4ef5-8399-b868b5c33264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1555ddbc-0d0e-49e4-8ff3-0a86152c9fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1555ddbc-0d0e-49e4-8ff3-0a86152c9fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1110927776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468fd597-ad16-45d1-9460-5e4ffc1b675a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8b9273c2c74ed8acbe6a25efabc242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:42Z,use_quota=True,user_id='f5db9ea0740e4de6ac768830a6c6dc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9d0cd3-6d37-4c5c-b62f-fef0b61bff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9d0cd3-6d37-4c5c-b62f-fef0b61bff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecc5897-f18b-4beb-8ac7-d8b969f0e1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecc5897-f18b-4beb-8ac7-d8b969f0e1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468fd597-ad16-45d1-9460-5e4ffc1b675a', 'volume_name': 'volume-468fd597-ad16-45d1-9460-5e4ffc1b675a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce10ee0c-92ac-41e6-bdf6-f20a08534d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce10ee0c-92ac-41e6-bdf6-f20a08534d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da9bb5f-dd3f-4d24-bf95-f3556b00685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:42 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Volume 468fd597-ad16-45d1-9460-5e4ffc1b675a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468fd597-ad16-45d1-9460-5e4ffc1b675a', 'volume_size': 1} Nov 02 10:06:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=46,cinder:SELECT=33,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:06:43 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" returned: 0 in 8.779s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e, size 1024.00 MB, duration 8.78 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:06:43 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Converted 1024.00 MB image at 116.63 MB/s Nov 02 10:06:43 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 is being set with open permissions: ugo+rw Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:43 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 Nov 02 10:06:43 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:43 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" returned: 0 in 0.273s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" released by "_copy_volume_from_snapshot" :: held 9.912s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-quobyte-faecef57-756b-4e04-8e75-62e6b4117b57" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-faecef57-756b-4e04-8e75-62e6b4117b57" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Deleting offline snapshot faecef57-756b-4e04-8e75-62e6b4117b57 of volume 40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] snapshot_file for this snap is: volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d901d5e-306c-4d44-b23c-ed1289b792c2]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:43 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 Nov 02 10:06:43 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:44 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57" returned: 0 in 0.381s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:06:44 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4df5927-b5b6-4329-b373-20ba78ab82dd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:44 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e Nov 02 10:06:44 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:44 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e" returned: 0 in 0.583s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:44 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 Nov 02 10:06:44 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:45 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57" returned: 0 in 0.411s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:45 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57 Nov 02 10:06:45 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:45 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e.faecef57-756b-4e04-8e75-62e6b4117b57" returned: 0 in 0.437s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-faecef57-756b-4e04-8e75-62e6b4117b57" released by "_delete_snapshot" :: held 1.955s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Flow 'volume_create_manager' (78632bb3-4dec-4a4f-9803-51d09cdf6899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8b8553-2051-40de-ab74-6d592f3ed8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.585s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.171s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1110927776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468fd597-ad16-45d1-9460-5e4ffc1b675a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8b9273c2c74ed8acbe6a25efabc242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:42Z,use_quota=True,user_id='f5db9ea0740e4de6ac768830a6c6dc5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Creating volume 468fd597-ad16-45d1-9460-5e4ffc1b675a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:45 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8b8553-2051-40de-ab74-6d592f3ed8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-409566957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72edda17-8203-45e1-ab5d-d6abcd53a923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b7e9ba59304a54bb1959e1fa1af1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:46Z,use_quota=True,user_id='81c0525425dc446a87c9e2acb0715e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01573404-b9ec-4009-8a82-2bbbe4eab474),volume_type_id=01573404-b9ec-4009-8a82-2bbbe4eab474)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e12233d-c44f-406f-89cd-575c5a25a17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:45 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a 1073741824 Nov 02 10:06:45 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e12233d-c44f-406f-89cd-575c5a25a17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f953e8c9-17fa-4ba3-8cc7-fdcc15f05c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f953e8c9-17fa-4ba3-8cc7-fdcc15f05c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72edda17-8203-45e1-ab5d-d6abcd53a923', 'volume_name': 'volume-72edda17-8203-45e1-ab5d-d6abcd53a923', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad0b8ca-3fb6-41fc-8c4b-bab480545a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad0b8ca-3fb6-41fc-8c4b-bab480545a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8beaa8-f37e-4f81-a061-50d36dc1c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:45 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Volume 72edda17-8203-45e1-ab5d-d6abcd53a923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72edda17-8203-45e1-ab5d-d6abcd53a923', 'volume_size': 1} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4308e1d0-d1ff-4b78-916b-cb832fa0b456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5', 'volume_size': 1, 'source_volid': '40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e', 'source_volstatus': 'available'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb53bbcc-7a1e-44bd-9810-f3e1c589f3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:45 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Volume volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 (ef2c37c5-4d7a-45e9-9a79-45261382c9d5): created successfully Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb53bbcc-7a1e-44bd-9810-f3e1c589f3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (53d19409-b9ee-43c4-9e77-7e5dd7f9210d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2f5a0265-83b9-4ae5-9da7-5187d7dcf24f tempest-VolumesGetTest-254331239 None] Created volume successfully. Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Flow 'volume_create_manager' (257e2fe8-6baf-4b82-9839-49cef5ef95d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee785af6-85da-4df0-a5a2-0bc8f70fbdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee785af6-85da-4df0-a5a2-0bc8f70fbdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1598636047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211a50c6-7ece-4100-b751-aba03d96636f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b7e9ba59304a54bb1959e1fa1af1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:46Z,use_quota=True,user_id='81c0525425dc446a87c9e2acb0715e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0629472-a1f0-43bf-bd2c-b790a8c04873),volume_type_id=b0629472-a1f0-43bf-bd2c-b790a8c04873)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb871fa8-b322-4b9f-b71e-a835c13eaf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb871fa8-b322-4b9f-b71e-a835c13eaf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a9c081-906b-4ae9-9932-9b09e6196dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a9c081-906b-4ae9-9932-9b09e6196dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211a50c6-7ece-4100-b751-aba03d96636f', 'volume_name': 'volume-211a50c6-7ece-4100-b751-aba03d96636f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab61f27-2a3e-4c56-8ccb-5045a1ef0e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab61f27-2a3e-4c56-8ccb-5045a1ef0e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167e097d-f2d5-4c88-a9c2-4df0f6473d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Volume 211a50c6-7ece-4100-b751-aba03d96636f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211a50c6-7ece-4100-b751-aba03d96636f', 'volume_size': 1} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:46 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a 1073741824" returned: 0 in 0.587s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:46 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a Nov 02 10:06:46 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:46 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a" returned: 0 in 0.284s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-409566957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72edda17-8203-45e1-ab5d-d6abcd53a923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b7e9ba59304a54bb1959e1fa1af1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:46Z,use_quota=True,user_id='81c0525425dc446a87c9e2acb0715e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01573404-b9ec-4009-8a82-2bbbe4eab474),volume_type_id=01573404-b9ec-4009-8a82-2bbbe4eab474)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Creating volume 72edda17-8203-45e1-ab5d-d6abcd53a923 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:46 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da9bb5f-dd3f-4d24-bf95-f3556b00685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468fd597-ad16-45d1-9460-5e4ffc1b675a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:46 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923 1073741824 Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b0e695-9762-4740-a233-ad81b3a19c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:46 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Volume volume-468fd597-ad16-45d1-9460-5e4ffc1b675a (468fd597-ad16-45d1-9460-5e4ffc1b675a): created successfully Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b0e695-9762-4740-a233-ad81b3a19c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Flow 'volume_create_manager' (10da0251-b73e-4ef5-8399-b868b5c33264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:46 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f615c43d-179d-4f3d-a759-cc171ae651dc tempest-AttachVolumeShelveTestJSON-780776991 None] Created volume successfully. Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Flow 'volume_create_manager' (e1f6d6eb-ccc1-4dd4-bb89-103b8d761113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bc9fa6-8ede-4e8c-ae4f-4fd48846a22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bc9fa6-8ede-4e8c-ae4f-4fd48846a22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1999491025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4dffe9f-27ed-4262-819f-9003c9e0d539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b7e9ba59304a54bb1959e1fa1af1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:47Z,use_quota=True,user_id='81c0525425dc446a87c9e2acb0715e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d582dd-51ab-452f-a46c-f5522994be3a),volume_type_id=b8d582dd-51ab-452f-a46c-f5522994be3a)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef1efdd-ee87-437a-87ee-6589ac63784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef1efdd-ee87-437a-87ee-6589ac63784e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f343063-7c8e-485b-b23e-e87ffdcc5ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:06:47 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923 1073741824" returned: 0 in 0.649s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:47 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923 Nov 02 10:06:47 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f343063-7c8e-485b-b23e-e87ffdcc5ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4dffe9f-27ed-4262-819f-9003c9e0d539', 'volume_name': 'volume-b4dffe9f-27ed-4262-819f-9003c9e0d539', 'volume_size': 1, 'image_id': '84def910-b4af-4e47-8b9e-93e0176b491e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84def910-b4af-4e47-8b9e-93e0176b491e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1659462510', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77b7e9ba59304a54bb1959e1fa1af1c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84def910-b4af-4e47-8b9e-93e0176b491e', 'created_at': datetime.datetime(2026, 11, 2, 9, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 6, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84def910-b4af-4e47-8b9e-93e0176b491e/file', 'properties': {}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c2a5b0-2288-4184-b2bd-ff32fee2323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c2a5b0-2288-4184-b2bd-ff32fee2323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bac7b5-dab6-4c16-9eda-0852d5e39268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Volume b4dffe9f-27ed-4262-819f-9003c9e0d539: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4dffe9f-27ed-4262-819f-9003c9e0d539', 'volume_size': 1, 'image_id': '84def910-b4af-4e47-8b9e-93e0176b491e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84def910-b4af-4e47-8b9e-93e0176b491e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1659462510', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77b7e9ba59304a54bb1959e1fa1af1c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84def910-b4af-4e47-8b9e-93e0176b491e', 'created_at': datetime.datetime(2026, 11, 2, 9, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 6, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84def910-b4af-4e47-8b9e-93e0176b491e/file', 'properties': {}}, 'image_service': } Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Trying to clone b4dffe9f-27ed-4262-819f-9003c9e0d539 from image 84def910-b4af-4e47-8b9e-93e0176b491e at location (None, [{'url': 'file:///opt/stack/data/glance/images/84def910-b4af-4e47-8b9e-93e0176b491e', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:06:47 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923" returned: 0 in 0.464s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1598636047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211a50c6-7ece-4100-b751-aba03d96636f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b7e9ba59304a54bb1959e1fa1af1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:46Z,use_quota=True,user_id='81c0525425dc446a87c9e2acb0715e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0629472-a1f0-43bf-bd2c-b790a8c04873),volume_type_id=b0629472-a1f0-43bf-bd2c-b790a8c04873)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Creating volume 211a50c6-7ece-4100-b751-aba03d96636f {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:47 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8beaa8-f37e-4f81-a061-50d36dc1c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72edda17-8203-45e1-ab5d-d6abcd53a923', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:47 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f 1073741824 Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1a1c2c-2288-484a-8728-ecd4e7174f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:47 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Volume volume-72edda17-8203-45e1-ab5d-d6abcd53a923 (72edda17-8203-45e1-ab5d-d6abcd53a923): created successfully Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1a1c2c-2288-484a-8728-ecd4e7174f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Flow 'volume_create_manager' (78632bb3-4dec-4a4f-9803-51d09cdf6899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (80e02f09-15bc-4c03-a0d6-0b8fb540b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaba33d-37db-40cb-b8b7-7d5ffacf9398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c4f1ad0d-1d4f-493d-80fa-ba2f56c53cd2 tempest-TestInstancesWithCinderVolumes-288339519 None] Created volume successfully. Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaba33d-37db-40cb-b8b7-7d5ffacf9398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-72387947',display_name='tempest-VolumesGetTest-Volume-23213640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ddf5fa-bad6-4c98-be2d-5668b93310eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:48Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc32a9d-1fe1-4c8e-8cd7-7d2b016c2361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc32a9d-1fe1-4c8e-8cd7-7d2b016c2361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d000f52a-8bb1-46e5-a170-48defa5b1e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d000f52a-8bb1-46e5-a170-48defa5b1e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ddf5fa-bad6-4c98-be2d-5668b93310eb', 'volume_name': 'volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8299d0-e92f-4533-b1c8-4bea2ba46f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8299d0-e92f-4533-b1c8-4bea2ba46f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9607567e-6e98-4074-85fb-6e0668de62de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Volume 82ddf5fa-bad6-4c98-be2d-5668b93310eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb', 'volume_size': 1} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:48 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f 1073741824" returned: 0 in 0.647s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:48 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f Nov 02 10:06:48 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:48 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f" returned: 0 in 0.331s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-72387947',display_name='tempest-VolumesGetTest-Volume-23213640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ddf5fa-bad6-4c98-be2d-5668b93310eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:48Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Creating volume 82ddf5fa-bad6-4c98-be2d-5668b93310eb {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:48 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167e097d-f2d5-4c88-a9c2-4df0f6473d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211a50c6-7ece-4100-b751-aba03d96636f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb 1073741824 Nov 02 10:06:48 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc28292-f954-475b-8344-95507048cb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:48 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Volume volume-211a50c6-7ece-4100-b751-aba03d96636f (211a50c6-7ece-4100-b751-aba03d96636f): created successfully Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc28292-f954-475b-8344-95507048cb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Flow 'volume_create_manager' (257e2fe8-6baf-4b82-9839-49cef5ef95d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d4f1ee98-be39-416c-b202-33e09f9e3ffc tempest-TestInstancesWithCinderVolumes-288339519 None] Created volume successfully. Nov 02 10:06:49 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb 1073741824" returned: 0 in 0.775s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:49 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb Nov 02 10:06:49 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:50 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb" returned: 0 in 0.419s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9607567e-6e98-4074-85fb-6e0668de62de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5470dfd-5f52-4e35-b2c1-8098c1b2354a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:50 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Volume volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb (82ddf5fa-bad6-4c98-be2d-5668b93310eb): created successfully Nov 02 10:06:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5470dfd-5f52-4e35-b2c1-8098c1b2354a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (80e02f09-15bc-4c03-a0d6-0b8fb540b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:50 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-419955e1-a9cf-4f3c-8b40-142d1fc0155c tempest-VolumesGetTest-254331239 None] Created volume successfully. Nov 02 10:06:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-82ddf5fa-bad6-4c98-be2d-5668b93310eb-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Lock "cinder-82ddf5fa-bad6-4c98-be2d-5668b93310eb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-quobyte-82ddf5fa-bad6-4c98-be2d-5668b93310eb" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-82ddf5fa-bad6-4c98-be2d-5668b93310eb" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:51 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0951250d-4685-4c35-a677-1500e26c7674]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:51 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb Nov 02 10:06:51 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:51 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb" returned: 0 in 0.436s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:52 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb Nov 02 10:06:52 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:52 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-82ddf5fa-bad6-4c98-be2d-5668b93310eb" returned: 0 in 0.285s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-82ddf5fa-bad6-4c98-be2d-5668b93310eb" released by "delete_volume" :: held 0.774s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Created reservations ['6dad0778-cec4-45c2-8f0a-a3eccc94fa15', 'd864d7ba-b125-4b8c-9735-35f74343a50f', 'ba601eed-1e04-4374-9ad3-a5f0f1bbe313', 'e61a9c8a-0bd4-438e-a306-cd4bbe2f295c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:52 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:06:52 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-ef2c37c5-4d7a-45e9-9a79-45261382c9d5-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Lock "cinder-ef2c37c5-4d7a-45e9-9a79-45261382c9d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-quobyte-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:52 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.364s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Deleted volume successfully. Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3212e8-a9ac-49f3-ac83-3e25f004632f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-059daf1a-e4ec-469e-9eeb-089baecfa727 tempest-VolumesGetTest-254331239 None] Lock "cinder-82ddf5fa-bad6-4c98-be2d-5668b93310eb-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:52 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD, size 20.69 MB, duration 5.28 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:06:52 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Image download 20.69 MB at 3.92 MB/s Nov 02 10:06:53 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 Nov 02 10:06:53 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2a6ddd-695c-475f-acf5-c5c4104c4b54]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:53 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD Nov 02 10:06:53 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:53 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" returned: 0 in 0.514s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:53 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5 Nov 02 10:06:53 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:53 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Temporary image 84def910-b4af-4e47-8b9e-93e0176b491e is fetched for user 81c0525425dc446a87c9e2acb0715e72. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1b368a-8c7d-4043-bc60-7926833dede1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:53 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" returned: 0 in 0.385s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-ef2c37c5-4d7a-45e9-9a79-45261382c9d5" released by "delete_volume" :: held 0.978s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:53 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD Nov 02 10:06:53 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:53 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Created reservations ['36121496-5d8b-46d9-b148-b4f40d438e09', '4a84fadd-19a1-4c63-96f0-19a4b4cf52b5', 'f4f6e9d9-a491-496c-a5a1-2c830577e29e', '9f4e0e21-4f23-469a-9556-a0ca7680b123'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:54 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:06:54 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:54 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1999491025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4dffe9f-27ed-4262-819f-9003c9e0d539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b7e9ba59304a54bb1959e1fa1af1c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:47Z,use_quota=True,user_id='81c0525425dc446a87c9e2acb0715e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8d582dd-51ab-452f-a46c-f5522994be3a),volume_type_id=b8d582dd-51ab-452f-a46c-f5522994be3a)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Creating volume b4dffe9f-27ed-4262-819f-9003c9e0d539 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:06:54 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:54 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 1073741824 Nov 02 10:06:54 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:54 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.336s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:54 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Deleted volume successfully. Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17058b7d-0d62-41e4-b437-8b2e819cb0b5 tempest-VolumesGetTest-254331239 None] Lock "cinder-ef2c37c5-4d7a-45e9-9a79-45261382c9d5-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:54 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 1073741824" returned: 0 in 0.549s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:54 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 Nov 02 10:06:54 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:55 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539" returned: 0 in 0.339s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Lock "cinder-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Attempting download of 84def910-b4af-4e47-8b9e-93e0176b491e ((None, [{'url': 'file:///opt/stack/data/glance/images/84def910-b4af-4e47-8b9e-93e0176b491e', 'metadata': {}}])) to volume b4dffe9f-27ed-4262-819f-9003c9e0d539. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-quobyte-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[275125d8-4b94-463b-868b-83ebcb498f18]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84def910-b4af-4e47-8b9e-93e0176b491e_luz1wx4s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e" acquired by "delete_volume" :: waited 0.042s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d224f5ab-8247-41a5-9ca7-fae7c24d9745]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:55 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84def910-b4af-4e47-8b9e-93e0176b491e_luz1wx4s Nov 02 10:06:55 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:55 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e Nov 02 10:06:55 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:55 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84def910-b4af-4e47-8b9e-93e0176b491e_luz1wx4s" returned: 0 in 0.387s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84def910-b4af-4e47-8b9e-93e0176b491e_luz1wx4s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:55 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84def910-b4af-4e47-8b9e-93e0176b491e_luz1wx4s Nov 02 10:06:55 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:55 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e" returned: 0 in 0.464s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:55 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e Nov 02 10:06:55 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:56 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84def910-b4af-4e47-8b9e-93e0176b491e_luz1wx4s" returned: 1 in 0.396s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84def910-b4af-4e47-8b9e-93e0176b491e_luz1wx4s' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd562fc4-a843-42de-a430-59764c26abb3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:56 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e" returned: 0 in 0.353s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:56 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD Nov 02 10:06:56 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e" released by "delete_volume" :: held 0.978s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Created reservations ['95b546ed-eabc-4786-ae88-4f1a7b87a816', '3b2f9b7b-25b1-4f65-9580-8500272fafaf', '61ef1f6a-3b81-432f-a86e-c7b095d01259', '0b9b2474-1bc9-4cae-b72b-80ece4c77785'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:56 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:06:56 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:56 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD" returned: 0 in 0.613s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] 84def910-b4af-4e47-8b9e-93e0176b491e was qcow2, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:06:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:56 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 Nov 02 10:06:56 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:57 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.405s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:57 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:06:57 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Deleted volume successfully. Nov 02 10:06:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a59b1c01-84da-4ef6-9098-a62d0494f984 tempest-VolumesGetTest-254331239 None] Lock "cinder-40c1e6b9-a5c8-4c22-9b44-36c6cadbbb5e-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (79b833d0-fd78-46f4-970d-d2fb9612b75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7223bf-7648-4f96-8c7d-ad418626d032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7223bf-7648-4f96-8c7d-ad418626d032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1287736731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e9c157-58eb-48a3-bc96-9ae56eff1c07,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:58Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fe725f-08bb-4a21-8192-b58b5cf3f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fe725f-08bb-4a21-8192-b58b5cf3f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25fcec8-1af9-4f43-be2f-8c4864e59df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25fcec8-1af9-4f43-be2f-8c4864e59df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01e9c157-58eb-48a3-bc96-9ae56eff1c07', 'volume_name': 'volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca243a8-86af-4b45-a0d5-3acc1c0461da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca243a8-86af-4b45-a0d5-3acc1c0461da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9165d00-e91f-4846-b760-8bd5d88e6f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:58 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Volume 01e9c157-58eb-48a3-bc96-9ae56eff1c07: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Trying to clone 01e9c157-58eb-48a3-bc96-9ae56eff1c07 from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:06:59 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539" returned: 0 in 2.404s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84def910-b4af-4e47-8b9e-93e0176b491e_rvz7mvvxdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:06:59 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Converted 112.00 MB image at 46.56 MB/s Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:59 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 1G Nov 02 10:06:59 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-ded2f929-3a88-4dd1-8dd1-6910a3114f9c req-6c827f3a-90d0-44c9-a002-4e3ddefc244e tempest-AttachVolumeShelveTestJSON-780776991 None] No connector for attachment f8675145-20c5-4a28-8d65-ec9e0b6dbdd9; skipping storage backend terminate_connection call. {{(pid=86840) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-ded2f929-3a88-4dd1-8dd1-6910a3114f9c req-6c827f3a-90d0-44c9-a002-4e3ddefc244e tempest-AttachVolumeShelveTestJSON-780776991 None] Deleting attachment f8675145-20c5-4a28-8d65-ec9e0b6dbdd9. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:06:59 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f44c0-1409-4435-bdf0-0a4e1c4e1f65]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:06:59 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 1G" returned: 0 in 0.490s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Downloaded image 84def910-b4af-4e47-8b9e-93e0176b491e ((None, [{'url': 'file:///opt/stack/data/glance/images/84def910-b4af-4e47-8b9e-93e0176b491e', 'metadata': {}}])) to volume b4dffe9f-27ed-4262-819f-9003c9e0d539 successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Temporary image 84def910-b4af-4e47-8b9e-93e0176b491e for user 81c0525425dc446a87c9e2acb0715e72 is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Marking volume b4dffe9f-27ed-4262-819f-9003c9e0d539 as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Copying metadata from image 84def910-b4af-4e47-8b9e-93e0176b491e to b4dffe9f-27ed-4262-819f-9003c9e0d539. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Creating volume glance metadata for volume b4dffe9f-27ed-4262-819f-9003c9e0d539 backed by image 84def910-b4af-4e47-8b9e-93e0176b491e with: {'image_id': '84def910-b4af-4e47-8b9e-93e0176b491e', 'image_name': 'tempest-scenario-img--1659462510', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:06:59 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD Nov 02 10:06:59 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bac7b5-dab6-4c16-9eda-0852d5e39268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4dffe9f-27ed-4262-819f-9003c9e0d539', 'volume_size': 1, 'image_id': '84def910-b4af-4e47-8b9e-93e0176b491e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84def910-b4af-4e47-8b9e-93e0176b491e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1659462510', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77b7e9ba59304a54bb1959e1fa1af1c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84def910-b4af-4e47-8b9e-93e0176b491e', 'created_at': datetime.datetime(2026, 11, 2, 9, 6, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 6, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84def910-b4af-4e47-8b9e-93e0176b491e/file', 'properties': {}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667cc1cc-6f4b-4deb-b5ef-4d6c76d38348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:06:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Volume volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 (b4dffe9f-27ed-4262-819f-9003c9e0d539): created successfully Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667cc1cc-6f4b-4deb-b5ef-4d6c76d38348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:06:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Flow 'volume_create_manager' (e1f6d6eb-ccc1-4dd4-bb89-103b8d761113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:06:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a9236a5d-eb87-40ed-ba09-92a5a85057fd tempest-TestInstancesWithCinderVolumes-288339519 None] Created volume successfully. Nov 02 10:07:00 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 is fetched for user 8c6e27bf05484623b4cd72ae15340574. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e769016-dc66-47ed-924c-cb553077e871]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:00 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD Nov 02 10:07:00 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:00 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1287736731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e9c157-58eb-48a3-bc96-9ae56eff1c07,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:58Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Creating volume 01e9c157-58eb-48a3-bc96-9ae56eff1c07 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:00 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:07:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:00 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 1073741824 Nov 02 10:07:00 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:01 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 1073741824" returned: 0 in 0.604s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:01 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 Nov 02 10:07:01 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:01 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07" returned: 0 in 0.447s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:01 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Attempting download of 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume 01e9c157-58eb-48a3-bc96-9ae56eff1c07. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:07:01 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b792eb-54c8-42f5-9815-3dca2528f76e]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iv9fwkil {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:01 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iv9fwkil Nov 02 10:07:01 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:02 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iv9fwkil" returned: 0 in 0.375s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iv9fwkil {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:02 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iv9fwkil Nov 02 10:07:02 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:02 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iv9fwkil" returned: 1 in 0.496s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iv9fwkil' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:07:02 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[60577223-1267-4d0b-bf50-d2b394c78f92]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:02 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD Nov 02 10:07:02 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:03 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:03 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 was qcow2, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:07:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:03 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 Nov 02 10:07:03 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:03 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=100,cinder:SELECT=67,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:07:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-6bda689f-e7ac-42ad-9733-a943cf79715b req-0efd2d07-93f6-4141-a624-95267b526e10 tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-6bda689f-e7ac-42ad-9733-a943cf79715b req-0efd2d07-93f6-4141-a624-95267b526e10 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-6bda689f-e7ac-42ad-9733-a943cf79715b req-0efd2d07-93f6-4141-a624-95267b526e10 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-6bda689f-e7ac-42ad-9733-a943cf79715b req-0efd2d07-93f6-4141-a624-95267b526e10 tempest-TestInstancesWithCinderVolumes-288339519 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-b4dffe9f-27ed-4262-819f-9003c9e0d539', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5832758a-2a25-4a18-8cd8-30f30b9750ed', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-6bda689f-e7ac-42ad-9733-a943cf79715b req-0efd2d07-93f6-4141-a624-95267b526e10 tempest-TestInstancesWithCinderVolumes-288339519 None] attachment_update completed successfully. Nov 02 10:07:06 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07" returned: 0 in 3.046s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:06 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1__afff4fhdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:07:06 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Converted 112.00 MB image at 36.76 MB/s Nov 02 10:07:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:06 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 1G Nov 02 10:07:06 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:06 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 1G" returned: 0 in 0.533s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:06 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Downloaded image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume 01e9c157-58eb-48a3-bc96-9ae56eff1c07 successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:07:06 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 for user 8c6e27bf05484623b4cd72ae15340574 is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:07:06 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Marking volume 01e9c157-58eb-48a3-bc96-9ae56eff1c07 as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:07:06 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Copying metadata from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 to 01e9c157-58eb-48a3-bc96-9ae56eff1c07. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:07:06 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Creating volume glance metadata for volume 01e9c157-58eb-48a3-bc96-9ae56eff1c07 backed by image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:07:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9165d00-e91f-4846-b760-8bd5d88e6f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376a8fe4-b567-4879-aba2-be3f217b468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Volume volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 (01e9c157-58eb-48a3-bc96-9ae56eff1c07): created successfully Nov 02 10:07:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376a8fe4-b567-4879-aba2-be3f217b468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (79b833d0-fd78-46f4-970d-d2fb9612b75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-18947536-f121-4524-ad5d-ae354dd6c94d tempest-VolumesGetTest-254331239 None] Created volume successfully. Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (d1230de7-5885-4299-9743-e888aab7ebb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35b0529-c542-44a1-9784-b8ca13da9f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35b0529-c542-44a1-9784-b8ca13da9f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-236477601',display_name='tempest-VolumesGetTest-Volume-411700700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d47bd4-f207-4537-8430-539e518b2f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:09Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b59e98-19f6-4e3f-9081-b3cfc8d5074c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b59e98-19f6-4e3f-9081-b3cfc8d5074c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d7306c-eca9-4c71-9043-1eb55245d855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d7306c-eca9-4c71-9043-1eb55245d855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d47bd4-f207-4537-8430-539e518b2f91', 'volume_name': 'volume-08d47bd4-f207-4537-8430-539e518b2f91', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69db076-551c-4228-b4d2-f31ce265bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69db076-551c-4228-b4d2-f31ce265bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87f54bb-a4a7-4628-9191-9781a5dff347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Volume 08d47bd4-f207-4537-8430-539e518b2f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d47bd4-f207-4537-8430-539e518b2f91', 'volume_size': 1} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-236477601',display_name='tempest-VolumesGetTest-Volume-411700700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d47bd4-f207-4537-8430-539e518b2f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fdb773e184290ac5105b138c40953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:09Z,use_quota=True,user_id='8c6e27bf05484623b4cd72ae15340574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Creating volume 08d47bd4-f207-4537-8430-539e518b2f91 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:08 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:07:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:09 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91 1073741824 Nov 02 10:07:09 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:09 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91 1073741824" returned: 0 in 0.745s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:09 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91 Nov 02 10:07:09 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:10 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91" returned: 0 in 0.345s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87f54bb-a4a7-4628-9191-9781a5dff347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d47bd4-f207-4537-8430-539e518b2f91', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f907a53e-84d7-4936-bd46-5fc467c24bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:10 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Volume volume-08d47bd4-f207-4537-8430-539e518b2f91 (08d47bd4-f207-4537-8430-539e518b2f91): created successfully Nov 02 10:07:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f907a53e-84d7-4936-bd46-5fc467c24bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Flow 'volume_create_manager' (d1230de7-5885-4299-9743-e888aab7ebb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-729ade74-e3c6-48f1-9a9f-e9895a4624ed tempest-VolumesGetTest-254331239 None] Created volume successfully. Nov 02 10:07:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-08d47bd4-f207-4537-8430-539e518b2f91-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Lock "cinder-08d47bd4-f207-4537-8430-539e518b2f91-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-quobyte-08d47bd4-f207-4537-8430-539e518b2f91" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-08d47bd4-f207-4537-8430-539e518b2f91" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:11 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d7ec0f-54e5-4988-aa3f-9a6689fb993b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:12 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91 Nov 02 10:07:12 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:12 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91" returned: 0 in 1.076s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:13 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91 Nov 02 10:07:13 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:13 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-08d47bd4-f207-4537-8430-539e518b2f91" returned: 0 in 0.752s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-08d47bd4-f207-4537-8430-539e518b2f91" released by "delete_volume" :: held 1.956s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:13 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Created reservations ['ad2fff8c-ca41-4683-97ce-bd6e4f51fbef', 'bbfaff33-985f-4df8-b388-b828a695a43e', 'eb0839fd-45f5-4b9a-8436-8d345271477d', 'ea46dd1f-4460-42ac-b4bb-1faef5860d53'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:14 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:07:14 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.630s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:14 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:14 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:14 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Deleted volume successfully. Nov 02 10:07:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2715c476-f466-4798-b078-5f4017f2351a tempest-VolumesGetTest-254331239 None] Lock "cinder-08d47bd4-f207-4537-8430-539e518b2f91-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-01e9c157-58eb-48a3-bc96-9ae56eff1c07-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Lock "cinder-01e9c157-58eb-48a3-bc96-9ae56eff1c07-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Acquiring lock "cinder-quobyte-01e9c157-58eb-48a3-bc96-9ae56eff1c07" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-01e9c157-58eb-48a3-bc96-9ae56eff1c07" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:15 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3329288b-b694-4508-b738-624887a2727d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:15 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 Nov 02 10:07:15 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:16 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07" returned: 0 in 0.563s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:16 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07 Nov 02 10:07:16 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:16 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-01e9c157-58eb-48a3-bc96-9ae56eff1c07" returned: 0 in 0.756s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Lock "cinder-quobyte-01e9c157-58eb-48a3-bc96-9ae56eff1c07" released by "delete_volume" :: held 1.410s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:16 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Created reservations ['c546c235-5f90-4258-a9e1-b5dd291d844a', '9c17ac13-227d-4acd-9c74-47caafd51adb', 'ebdf317a-aae0-4857-8711-cd55a97e4693', '3116ed35-e2f1-44c6-b9c1-967a8ebc0c66'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:17 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:07:17 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:17 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.395s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:17 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Deleted volume successfully. Nov 02 10:07:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b06375f-9186-4b64-99a4-607ab803e760 tempest-VolumesGetTest-254331239 None] Lock "cinder-01e9c157-58eb-48a3-bc96-9ae56eff1c07-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:07:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:20 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:07:20 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:21 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.649s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:07:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:07:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Flow 'volume_create_manager' (6230fe85-87eb-4ad1-9b1e-c7a8339f7962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15deb320-6ece-431c-8be1-39ec1e8f2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15deb320-6ece-431c-8be1-39ec1e8f2d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-353084505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0007286c-2c06-4556-856d-ef0d9b69cd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c40d7edc8a4fd3bb499457798d1cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:24Z,use_quota=True,user_id='af0184addfcd48cbaa897b3aac8df868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814ec99b-7a22-4a89-950d-02b719adfb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814ec99b-7a22-4a89-950d-02b719adfb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5250dc9a-092e-4cb1-a2e1-c90aa797de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5250dc9a-092e-4cb1-a2e1-c90aa797de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0007286c-2c06-4556-856d-ef0d9b69cd09', 'volume_name': 'volume-0007286c-2c06-4556-856d-ef0d9b69cd09', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d7476c-602b-41f0-be21-d6d2e527aed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d7476c-602b-41f0-be21-d6d2e527aed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf968ea2-8e41-4189-851c-823a70a1e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:24 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Volume 0007286c-2c06-4556-856d-ef0d9b69cd09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0007286c-2c06-4556-856d-ef0d9b69cd09', 'volume_size': 1} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-353084505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0007286c-2c06-4556-856d-ef0d9b69cd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3c40d7edc8a4fd3bb499457798d1cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:24Z,use_quota=True,user_id='af0184addfcd48cbaa897b3aac8df868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Creating volume 0007286c-2c06-4556-856d-ef0d9b69cd09 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:24 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:07:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:24 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09 1073741824 Nov 02 10:07:24 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:25 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09 1073741824" returned: 0 in 0.457s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:25 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09 Nov 02 10:07:25 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:25 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09" returned: 0 in 0.301s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf968ea2-8e41-4189-851c-823a70a1e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0007286c-2c06-4556-856d-ef0d9b69cd09', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7eaa8e1-39fe-41c1-a9fc-cf14c0e8feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:25 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Volume volume-0007286c-2c06-4556-856d-ef0d9b69cd09 (0007286c-2c06-4556-856d-ef0d9b69cd09): created successfully Nov 02 10:07:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7eaa8e1-39fe-41c1-a9fc-cf14c0e8feec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Flow 'volume_create_manager' (6230fe85-87eb-4ad1-9b1e-c7a8339f7962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bd31ddc4-f598-40bc-8867-114b3d968646 tempest-VolumesNegativeTest-870948600 None] Created volume successfully. Nov 02 10:07:35 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=65,cinder:SELECT=61,cinder:INSERT=22,cinder:DELETE=9 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:07:35 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=26,cinder:INSERT=12,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:07:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Acquiring lock "cinder-468fd597-ad16-45d1-9460-5e4ffc1b675a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "cinder-468fd597-ad16-45d1-9460-5e4ffc1b675a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Acquiring lock "cinder-quobyte-468fd597-ad16-45d1-9460-5e4ffc1b675a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "cinder-quobyte-468fd597-ad16-45d1-9460-5e4ffc1b675a" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:40 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a2e349-a2ee-4d92-9ce2-c65e427e7c66]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:41 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a Nov 02 10:07:41 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:41 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a" returned: 0 in 0.394s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:41 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a Nov 02 10:07:41 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:41 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-468fd597-ad16-45d1-9460-5e4ffc1b675a" returned: 0 in 0.261s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "cinder-quobyte-468fd597-ad16-45d1-9460-5e4ffc1b675a" released by "delete_volume" :: held 0.711s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Created reservations ['f7ac2827-8661-4014-bc66-eb5e58ea797c', '74b3e2df-846d-4665-a16e-279320aeccb2', 'ca9572e1-bf9b-46a2-8ee4-f0cc6d2af984', 'c787a58f-547b-470e-9c80-840e27ff8bf5'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:41 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:07:41 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:42 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.281s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:42 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:42 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Deleted volume successfully. Nov 02 10:07:42 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30bf9580-dd9b-4a00-ba52-150179c4c7d7 tempest-AttachVolumeShelveTestJSON-780776991 None] Lock "cinder-468fd597-ad16-45d1-9460-5e4ffc1b675a-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-7889743e-492c-462c-a099-0385a872ddad req-86fb5fc9-427b-436f-8e29-d586d2be1c84 tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-7889743e-492c-462c-a099-0385a872ddad req-86fb5fc9-427b-436f-8e29-d586d2be1c84 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-7889743e-492c-462c-a099-0385a872ddad req-86fb5fc9-427b-436f-8e29-d586d2be1c84 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-7889743e-492c-462c-a099-0385a872ddad req-86fb5fc9-427b-436f-8e29-d586d2be1c84 tempest-TestInstancesWithCinderVolumes-288339519 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-72edda17-8203-45e1-ab5d-d6abcd53a923', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d8c2c92-ce86-4a5e-92dc-a0fc087e0b56', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:43 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-7889743e-492c-462c-a099-0385a872ddad req-86fb5fc9-427b-436f-8e29-d586d2be1c84 tempest-TestInstancesWithCinderVolumes-288339519 None] attachment_update completed successfully. Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-ba5c5075-a96c-4bcc-8c70-81ca4a55276e req-15e7cf7f-183a-43f6-b804-a54691ebacfd tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-ba5c5075-a96c-4bcc-8c70-81ca4a55276e req-15e7cf7f-183a-43f6-b804-a54691ebacfd tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-ba5c5075-a96c-4bcc-8c70-81ca4a55276e req-15e7cf7f-183a-43f6-b804-a54691ebacfd tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-ba5c5075-a96c-4bcc-8c70-81ca4a55276e req-15e7cf7f-183a-43f6-b804-a54691ebacfd tempest-TestInstancesWithCinderVolumes-288339519 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-211a50c6-7ece-4100-b751-aba03d96636f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3615f7a8-e990-48f9-ab76-ae1e33c77463', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:07:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-ba5c5075-a96c-4bcc-8c70-81ca4a55276e req-15e7cf7f-183a-43f6-b804-a54691ebacfd tempest-TestInstancesWithCinderVolumes-288339519 None] attachment_update completed successfully. Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Acquiring lock "cinder-0007286c-2c06-4556-856d-ef0d9b69cd09-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Lock "cinder-0007286c-2c06-4556-856d-ef0d9b69cd09-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Acquiring lock "cinder-quobyte-0007286c-2c06-4556-856d-ef0d9b69cd09" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Lock "cinder-quobyte-0007286c-2c06-4556-856d-ef0d9b69cd09" acquired by "delete_volume" :: waited 0.036s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e708dd-c57f-4032-9688-65f87f09e3fe]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:48 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09 Nov 02 10:07:48 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:48 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09" returned: 0 in 0.469s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:48 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09 Nov 02 10:07:48 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:48 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0007286c-2c06-4556-856d-ef0d9b69cd09" returned: 0 in 0.331s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Lock "cinder-quobyte-0007286c-2c06-4556-856d-ef0d9b69cd09" released by "delete_volume" :: held 0.868s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Created reservations ['8fc511f6-d1b6-4ce6-b100-c93b0f31f2e5', '80738358-f87a-4b87-94a6-07e004af36ab', '2f8cb1c8-62fa-4a31-9f3c-5d2686f644b5', 'd2b0838e-747a-4bb9-bfd1-3b353c43a30c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:48 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:07:48 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:49 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.372s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:49 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Deleted volume successfully. Nov 02 10:07:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57f4dced-264c-492e-9a4b-8941892ef81a tempest-VolumesNegativeTest-870948600 None] Lock "cinder-0007286c-2c06-4556-856d-ef0d9b69cd09-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Flow 'volume_create_manager' (4fe6e9c7-bc9c-4eb5-918a-6b08639ffcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d2f37d-da84-4c51-94a5-7b4aedaefaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d2f37d-da84-4c51-94a5-7b4aedaefaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1752498419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a07c8e8-6a63-414a-9b28-edaa5f28bc21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='351d8d48e3394f1e87cb5eca7d34b865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:52Z,use_quota=True,user_id='8b78f0c2f63d4b74a0e09ef5aeed9d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0511ba73-35a5-4925-91a9-b68d7f3ca106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0511ba73-35a5-4925-91a9-b68d7f3ca106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5932e589-241d-45c8-8efe-64d5766bdd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5932e589-241d-45c8-8efe-64d5766bdd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a07c8e8-6a63-414a-9b28-edaa5f28bc21', 'volume_name': 'volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b7b319-5ab8-46ab-8179-bec5b90f4d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b7b319-5ab8-46ab-8179-bec5b90f4d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb065663-9577-43ac-84f1-c0fca43d5083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:52 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Volume 6a07c8e8-6a63-414a-9b28-edaa5f28bc21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21', 'volume_size': 1} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1752498419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a07c8e8-6a63-414a-9b28-edaa5f28bc21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='351d8d48e3394f1e87cb5eca7d34b865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:52Z,use_quota=True,user_id='8b78f0c2f63d4b74a0e09ef5aeed9d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Creating volume 6a07c8e8-6a63-414a-9b28-edaa5f28bc21 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:07:52 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:07:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:52 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 1073741824 Nov 02 10:07:52 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:53 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 1073741824" returned: 0 in 0.596s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:53 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 Nov 02 10:07:53 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:53 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21" returned: 0 in 0.415s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:07:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:53 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb065663-9577-43ac-84f1-c0fca43d5083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:53 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6871ea2-4e94-4f44-8015-8b25909db49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:07:53 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Volume volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 (6a07c8e8-6a63-414a-9b28-edaa5f28bc21): created successfully Nov 02 10:07:53 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6871ea2-4e94-4f44-8015-8b25909db49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:07:53 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Flow 'volume_create_manager' (4fe6e9c7-bc9c-4eb5-918a-6b08639ffcf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:07:53 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-d8d4ba01-2433-4fbf-b472-7dbed595bc98 req-3c7536bb-a0bf-4beb-884a-480da5326fb6 tempest-VolumesGetTestJSON-2005636255 None] Created volume successfully. Nov 02 10:07:54 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-c414e54b-191f-41a2-b59b-e51b60297c0d req-1a1be304-495a-4d6e-b5fe-2dcb959ee88c tempest-TestInstancesWithCinderVolumes-288339519 None] Terminate volume connection completed successfully. Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-c414e54b-191f-41a2-b59b-e51b60297c0d req-1a1be304-495a-4d6e-b5fe-2dcb959ee88c tempest-TestInstancesWithCinderVolumes-288339519 None] Deleting attachment 8d8c2c92-ce86-4a5e-92dc-a0fc087e0b56. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Acquiring lock "cinder-6a07c8e8-6a63-414a-9b28-edaa5f28bc21-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Lock "cinder-6a07c8e8-6a63-414a-9b28-edaa5f28bc21-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "cinder-72edda17-8203-45e1-ab5d-d6abcd53a923-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-72edda17-8203-45e1-ab5d-d6abcd53a923-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Acquiring lock "cinder-quobyte-6a07c8e8-6a63-414a-9b28-edaa5f28bc21" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "cinder-quobyte-72edda17-8203-45e1-ab5d-d6abcd53a923" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Lock "cinder-quobyte-6a07c8e8-6a63-414a-9b28-edaa5f28bc21" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-quobyte-72edda17-8203-45e1-ab5d-d6abcd53a923" acquired by "delete_volume" :: waited 0.048s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae91540-08cb-4671-9a24-fdcc0c9cba36]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:55 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b449ae-14d9-4beb-a9f8-874e1cce7e20]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:07:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:55 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 Nov 02 10:07:55 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:55 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923 Nov 02 10:07:55 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:55 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21" returned: 0 in 0.633s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:55 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923" returned: 0 in 0.644s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:55 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21 Nov 02 10:07:55 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:55 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923 Nov 02 10:07:55 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:55 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:55 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-72edda17-8203-45e1-ab5d-d6abcd53a923" returned: 0 in 0.321s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6a07c8e8-6a63-414a-9b28-edaa5f28bc21" returned: 0 in 0.359s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Lock "cinder-quobyte-6a07c8e8-6a63-414a-9b28-edaa5f28bc21" released by "delete_volume" :: held 1.074s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-quobyte-72edda17-8203-45e1-ab5d-d6abcd53a923" released by "delete_volume" :: held 1.050s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:56 devstack cinder-volume[86840]: WARNING cinder.quota [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1965535483-1274545010 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1965535483-1274545010, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:07:56 devstack cinder-volume[86840]: WARNING cinder.quota [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1965535483-1274545010 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1965535483-1274545010, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Created reservations ['55146682-8bb0-41a7-ace6-1082e8888fee', '76683ef3-b742-4b73-a482-79611a3f826a', '72275e45-b5be-4447-aee3-94272165db8c', 'a5b0dc44-e4b3-4a09-a626-020ac2d2aa27'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.quota [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Created reservations ['4639e891-f7a7-4404-bae0-59c8ed1e6959', 'f0aff3e0-068a-40f0-8729-49838e9d9b69', 'fc266603-fdfb-48ad-8e38-6d8f955bda99', '0af5fc2f-e9d2-4b65-8748-6ee916cdff81'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:56 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:07:56 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:07:56 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:07:56 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:07:56 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.310s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Deleted volume successfully. Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eed72016-56d3-41d9-841f-bdecc93ab0c2 tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-72edda17-8203-45e1-ab5d-d6abcd53a923-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:56 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.298s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.manager [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:07:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Deleted volume successfully. Nov 02 10:07:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-924dafbd-bdf5-45c1-906f-4d509559315c req-6f65d90f-291f-41d9-aedc-fc222bcf6b81 tempest-VolumesGetTestJSON-2005636255 None] Lock "cinder-6a07c8e8-6a63-414a-9b28-edaa5f28bc21-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:07:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-2e5d5f66-0f9d-4cf3-b229-032810a220c7 req-33f1f894-1f5e-4ba0-a78b-15c7f85351b3 tempest-TestInstancesWithCinderVolumes-288339519 None] Terminate volume connection completed successfully. Nov 02 10:07:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-2e5d5f66-0f9d-4cf3-b229-032810a220c7 req-33f1f894-1f5e-4ba0-a78b-15c7f85351b3 tempest-TestInstancesWithCinderVolumes-288339519 None] Deleting attachment 3615f7a8-e990-48f9-ab76-ae1e33c77463. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:08:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "cinder-211a50c6-7ece-4100-b751-aba03d96636f-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-211a50c6-7ece-4100-b751-aba03d96636f-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "cinder-quobyte-211a50c6-7ece-4100-b751-aba03d96636f" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-quobyte-211a50c6-7ece-4100-b751-aba03d96636f" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0324a864-e2a2-458e-909f-7b4fd5aef95c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:01 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f Nov 02 10:08:01 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:01 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f" returned: 0 in 0.595s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:01 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f Nov 02 10:08:01 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:01 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-211a50c6-7ece-4100-b751-aba03d96636f" returned: 0 in 0.355s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-quobyte-211a50c6-7ece-4100-b751-aba03d96636f" released by "delete_volume" :: held 1.033s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:01 devstack cinder-volume[86840]: WARNING cinder.quota [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1430179901-468974945 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1430179901-468974945, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:08:01 devstack cinder-volume[86840]: WARNING cinder.quota [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1430179901-468974945 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1430179901-468974945, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:08:01 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Created reservations ['0ca29d43-1312-40fc-a582-12c9bbf2c21a', '2f36dad9-afd4-4512-9efd-0d6b041a4182', '37d8070d-0d0f-4a52-af36-f67885fec058', '4a0793da-31a8-4825-bf2b-27d05feb1c15'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:02 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:08:02 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:02 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.395s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:02 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Deleted volume successfully. Nov 02 10:08:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5d00a0d2-8421-403d-8a7c-72540ccb137a tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-211a50c6-7ece-4100-b751-aba03d96636f-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2048af33-0f43-4d29-8488-7e7b46de5f6c tempest-BackendsCapabilitiesAdminTestsJSON-395507970 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8139152526855, 'free_capacity_gb': 1773.8139152526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86840) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:08:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-901a4279-9b23-4d21-a88c-fae40ebfad10 tempest-BackendsCapabilitiesAdminTestsJSON-395507970 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8139152526855, 'free_capacity_gb': 1773.8139152526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86840) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:08:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-a63ba242-385b-4b2b-9fa6-1991087c4807 req-4a90ae12-c2ce-4655-9f2d-7d7c1c31181c tempest-TestInstancesWithCinderVolumes-288339519 None] Terminate volume connection completed successfully. Nov 02 10:08:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-a63ba242-385b-4b2b-9fa6-1991087c4807 req-4a90ae12-c2ce-4655-9f2d-7d7c1c31181c tempest-TestInstancesWithCinderVolumes-288339519 None] Deleting attachment 5832758a-2a25-4a18-8cd8-30f30b9750ed. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:08:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "cinder-b4dffe9f-27ed-4262-819f-9003c9e0d539-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-b4dffe9f-27ed-4262-819f-9003c9e0d539-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "cinder-quobyte-b4dffe9f-27ed-4262-819f-9003c9e0d539" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-quobyte-b4dffe9f-27ed-4262-819f-9003c9e0d539" acquired by "delete_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:10 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebb86a7-f206-40ea-9671-f86d1ccd35aa]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:10 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 Nov 02 10:08:10 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:10 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539" returned: 0 in 0.510s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:10 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539 Nov 02 10:08:10 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:10 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b4dffe9f-27ed-4262-819f-9003c9e0d539" returned: 0 in 0.273s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-quobyte-b4dffe9f-27ed-4262-819f-9003c9e0d539" released by "delete_volume" :: held 0.839s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:11 devstack cinder-volume[86840]: WARNING cinder.quota [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462134916-1410439440 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462134916-1410439440, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:08:11 devstack cinder-volume[86840]: WARNING cinder.quota [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462134916-1410439440 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462134916-1410439440, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Created reservations ['b5fee337-4557-4a5c-b373-858b98ff0c95', '59b0e1d9-1ae4-497d-8526-8d93237e35ae', 'ab373743-15a8-4c48-bf6c-42dce45e0bfd', 'e60f613d-79c2-4872-a5d2-28dc0bea8b64'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:11 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:08:11 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:11 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.580s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:11 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Deleted volume successfully. Nov 02 10:08:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b8bb3166-9ac5-4dc9-96fa-d94a6b0f721d tempest-TestInstancesWithCinderVolumes-288339519 None] Lock "cinder-b4dffe9f-27ed-4262-819f-9003c9e0d539-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:08:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:20 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:08:20 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:21 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.306s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:08:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:08:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:08:21 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=49,cinder:INSERT=11,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:08:21 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=48,cinder:UPDATE=53,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Flow 'volume_create_manager' (74ba389a-f074-42a1-8e9b-ee5ba0c7f5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e13cb57-d9a8-476f-a6d9-8381a0a09d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e13cb57-d9a8-476f-a6d9-8381a0a09d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-673565326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74096a12305642bdb0834581be4202a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:24Z,use_quota=True,user_id='d1b7220abcab4dfe9074c7651970a550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be8a041-4abf-4f95-838f-951082fccfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be8a041-4abf-4f95-838f-951082fccfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496ed002-22ab-4f85-b204-a4e6ea29c934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496ed002-22ab-4f85-b204-a4e6ea29c934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd', 'volume_name': 'volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbc522e-aa44-4c9e-b154-8576446c64d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbc522e-aa44-4c9e-b154-8576446c64d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd39c2d2-ec4a-4a46-be1c-8ab5d10e7b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:23 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Volume b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd', 'volume_size': 1} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-673565326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74096a12305642bdb0834581be4202a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:24Z,use_quota=True,user_id='d1b7220abcab4dfe9074c7651970a550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Creating volume b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:23 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:08:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:23 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd 1073741824 Nov 02 10:08:23 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Flow 'volume_create_manager' (55d8b420-4460-45ec-9e94-fe989c6d5008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79830c96-d317-4762-9617-93ab82673cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79830c96-d317-4762-9617-93ab82673cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1874619183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f52f0a9-be1e-43fe-a771-49f9c0f46282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74096a12305642bdb0834581be4202a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:24Z,use_quota=True,user_id='d1b7220abcab4dfe9074c7651970a550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a679d20-758b-47bf-bedd-8ed7225de14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a679d20-758b-47bf-bedd-8ed7225de14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4860a298-9207-40ce-aa6c-a6c4a392e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4860a298-9207-40ce-aa6c-a6c4a392e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f52f0a9-be1e-43fe-a771-49f9c0f46282', 'volume_name': 'volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ae0fca-1c18-4bae-8af9-05282fe9d11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ae0fca-1c18-4bae-8af9-05282fe9d11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8c95e7-e3a3-496b-b561-1363719fdd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:24 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Volume 9f52f0a9-be1e-43fe-a771-49f9c0f46282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282', 'volume_size': 1} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:24 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd 1073741824" returned: 0 in 0.796s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:24 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd Nov 02 10:08:24 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:25 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd" returned: 0 in 0.474s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1874619183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f52f0a9-be1e-43fe-a771-49f9c0f46282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74096a12305642bdb0834581be4202a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:24Z,use_quota=True,user_id='d1b7220abcab4dfe9074c7651970a550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Creating volume 9f52f0a9-be1e-43fe-a771-49f9c0f46282 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:25 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:25 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 1073741824 Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd39c2d2-ec4a-4a46-be1c-8ab5d10e7b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:25 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7408da82-a5ee-4a9c-9ecb-b8235028ccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:25 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Volume volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd (b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd): created successfully Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7408da82-a5ee-4a9c-9ecb-b8235028ccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Flow 'volume_create_manager' (74ba389a-f074-42a1-8e9b-ee5ba0c7f5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d3c6b372-9e67-4e7e-a69f-917e0212d61b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Created volume successfully. Nov 02 10:08:25 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 1073741824" returned: 0 in 0.748s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:26 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 Nov 02 10:08:26 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:26 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282" returned: 0 in 0.340s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8c95e7-e3a3-496b-b561-1363719fdd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc061f89-e5f2-4d55-b793-4417fd5fd596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:26 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Volume volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 (9f52f0a9-be1e-43fe-a771-49f9c0f46282): created successfully Nov 02 10:08:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc061f89-e5f2-4d55-b793-4417fd5fd596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Flow 'volume_create_manager' (55d8b420-4460-45ec-9e94-fe989c6d5008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e05c4bed-50d5-4096-9039-e7d1e2ae67f6 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Created volume successfully. Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Flow 'volume_create_manager' (e58c93a3-0230-42e7-99fd-3db446f481e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8c5f80-7320-4e4e-a4c9-11301b5853de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8c5f80-7320-4e4e-a4c9-11301b5853de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1282262625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b110a9ef-edb6-4c8c-906b-37f823d169b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4891f0257ad64b1c8ef722d9590af969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:27Z,use_quota=True,user_id='41fe27e9334c4f06bf8a9cd508986488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26399456-3134-4128-a44b-2506b1c73f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26399456-3134-4128-a44b-2506b1c73f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743c16a4-8db1-4cc7-9a35-db03d8944d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743c16a4-8db1-4cc7-9a35-db03d8944d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b110a9ef-edb6-4c8c-906b-37f823d169b2', 'volume_name': 'volume-b110a9ef-edb6-4c8c-906b-37f823d169b2', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63423aeb-f56d-4ddc-be21-0016e038e5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63423aeb-f56d-4ddc-be21-0016e038e5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8744fdac-b154-4eb1-aa06-b21dd3db8b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:27 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Volume b110a9ef-edb6-4c8c-906b-37f823d169b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b110a9ef-edb6-4c8c-906b-37f823d169b2', 'volume_size': 1} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1282262625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b110a9ef-edb6-4c8c-906b-37f823d169b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4891f0257ad64b1c8ef722d9590af969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:27Z,use_quota=True,user_id='41fe27e9334c4f06bf8a9cd508986488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Creating volume b110a9ef-edb6-4c8c-906b-37f823d169b2 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:27 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:27 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 1073741824 Nov 02 10:08:27 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:27 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 1073741824" returned: 0 in 0.612s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:28 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 Nov 02 10:08:28 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:28 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2" returned: 0 in 0.321s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8744fdac-b154-4eb1-aa06-b21dd3db8b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b110a9ef-edb6-4c8c-906b-37f823d169b2', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412fc7e6-592d-47c0-b0ef-822a1b1fc814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:28 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Volume volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 (b110a9ef-edb6-4c8c-906b-37f823d169b2): created successfully Nov 02 10:08:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412fc7e6-592d-47c0-b0ef-822a1b1fc814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Flow 'volume_create_manager' (e58c93a3-0230-42e7-99fd-3db446f481e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-585a287e-c257-4d6b-bfca-5376cb76d112 tempest-VolumeQuotasNegativeTestJSON-554574842 None] Created volume successfully. Nov 02 10:08:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Acquiring lock "cinder-b110a9ef-edb6-4c8c-906b-37f823d169b2-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "cinder-b110a9ef-edb6-4c8c-906b-37f823d169b2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Acquiring lock "cinder-quobyte-b110a9ef-edb6-4c8c-906b-37f823d169b2" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "cinder-quobyte-b110a9ef-edb6-4c8c-906b-37f823d169b2" acquired by "delete_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:31 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[57009b14-3a54-4430-8e39-3cefe7bdb94d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:31 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 Nov 02 10:08:31 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:32 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2" returned: 0 in 0.520s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:32 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2 Nov 02 10:08:32 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:32 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b110a9ef-edb6-4c8c-906b-37f823d169b2" returned: 0 in 0.320s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "cinder-quobyte-b110a9ef-edb6-4c8c-906b-37f823d169b2" released by "delete_volume" :: held 0.917s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Created reservations ['38768d5d-b2fe-4134-b7c7-7380a4eceb43', '34297cff-3b74-4d2f-8493-20428cb3a10f', 'e870db8c-4548-4b8f-8994-ce7a0fba3527', 'a8ad7dcc-a8a3-4c4a-8cb1-16e76ac1b86d'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:32 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:08:32 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:32 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.330s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:32 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:08:32 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Deleted volume successfully. Nov 02 10:08:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1860c76f-e45b-4069-bf7a-c99b43fa17aa tempest-VolumeQuotasNegativeTestJSON-554574842 None] Lock "cinder-b110a9ef-edb6-4c8c-906b-37f823d169b2-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-caa24c11-a01e-43b3-a0fa-3106afb854d8 req-11ce187f-6b27-4199-9ea3-bd4ec8b8203c tempest-AttachVolumeTestJSON-12520340 None] Terminate volume connection completed successfully. Nov 02 10:08:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-caa24c11-a01e-43b3-a0fa-3106afb854d8 req-11ce187f-6b27-4199-9ea3-bd4ec8b8203c tempest-AttachVolumeTestJSON-12520340 None] Deleting attachment dcf720c4-c442-4add-869b-d9334c6d78dc. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Flow 'volume_create_manager' (d1f16752-862d-4c5f-9c2e-8b69cbcc72f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2312f4b5-ab51-400a-a5a0-30b23eee98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2312f4b5-ab51-400a-a5a0-30b23eee98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-972552870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce636271-64c7-4722-a822-1d54be98597a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8843bd8e0f4dfe81a82e378b935b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:47Z,use_quota=True,user_id='b2f8e86557864e8c979b09c7310bfea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e70e061-5c30-4d34-bab3-d39a85606330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e70e061-5c30-4d34-bab3-d39a85606330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6278b5e0-8fe3-4dc3-aabf-d2ff16edadcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6278b5e0-8fe3-4dc3-aabf-d2ff16edadcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce636271-64c7-4722-a822-1d54be98597a', 'volume_name': 'volume-ce636271-64c7-4722-a822-1d54be98597a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7d9d5c-f509-4f71-b3e8-796b3a83c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7d9d5c-f509-4f71-b3e8-796b3a83c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131a439d-b32b-4ac8-afe8-abfacd476cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Volume ce636271-64c7-4722-a822-1d54be98597a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce636271-64c7-4722-a822-1d54be98597a', 'volume_size': 1} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-972552870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce636271-64c7-4722-a822-1d54be98597a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8843bd8e0f4dfe81a82e378b935b64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:47Z,use_quota=True,user_id='b2f8e86557864e8c979b09c7310bfea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Creating volume ce636271-64c7-4722-a822-1d54be98597a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:08:47 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:08:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:47 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a 1073741824 Nov 02 10:08:47 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:48 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a 1073741824" returned: 0 in 0.954s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:48 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a Nov 02 10:08:48 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:48 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a" returned: 0 in 0.545s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:08:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131a439d-b32b-4ac8-afe8-abfacd476cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce636271-64c7-4722-a822-1d54be98597a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cbca8b-27c6-49c8-92c9-a1943139d2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:08:48 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Volume volume-ce636271-64c7-4722-a822-1d54be98597a (ce636271-64c7-4722-a822-1d54be98597a): created successfully Nov 02 10:08:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6cbca8b-27c6-49c8-92c9-a1943139d2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:08:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Flow 'volume_create_manager' (d1f16752-862d-4c5f-9c2e-8b69cbcc72f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:08:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5a08d8e7-7e0e-420c-9595-c0f517489335 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Created volume successfully. Nov 02 10:08:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Creating offline snapshot b2727045-70a7-4a48-9510-ed66eea885d6 of volume ce636271-64c7-4722-a822-1d54be98597a {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:08:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d88ca9-842d-401a-8d75-271aff619259]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:50 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a Nov 02 10:08:50 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:50 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a" returned: 0 in 0.685s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:50 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 1G Nov 02 10:08:50 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:51 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 1G" returned: 0 in 0.695s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce636271-64c7-4722-a822-1d54be98597a -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:51 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce636271-64c7-4722-a822-1d54be98597a -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 Nov 02 10:08:51 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:51 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce636271-64c7-4722-a822-1d54be98597a -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6" returned: 0 in 0.412s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:51 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 is being set with open permissions: ugo+rw Nov 02 10:08:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:51 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 Nov 02 10:08:51 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:52 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6" returned: 0 in 0.310s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:52 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.info Nov 02 10:08:52 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:52 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.info" returned: 0 in 0.295s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:52 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.info is being set with open permissions: ugo+rw Nov 02 10:08:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:52 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.info Nov 02 10:08:52 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:52 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.info" returned: 0 in 0.393s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.940s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b06bbf7f-5b9c-4364-98d6-f0e3b87da702 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Create snapshot completed successfully Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Acquiring lock "cinder-b2727045-70a7-4a48-9510-ed66eea885d6-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-b2727045-70a7-4a48-9510-ed66eea885d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Acquiring lock "cinder-quobyte-ce636271-64c7-4722-a822-1d54be98597a" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-quobyte-ce636271-64c7-4722-a822-1d54be98597a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Acquiring lock "cinder-quobyte-b2727045-70a7-4a48-9510-ed66eea885d6" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-quobyte-b2727045-70a7-4a48-9510-ed66eea885d6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Deleting offline snapshot b2727045-70a7-4a48-9510-ed66eea885d6 of volume ce636271-64c7-4722-a822-1d54be98597a {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] snapshot_file for this snap is: volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf2433b-fd20-42d2-914c-7dca1a4d656b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:53 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 Nov 02 10:08:53 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:54 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6" returned: 0 in 0.555s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce636271-64c7-4722-a822-1d54be98597a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:08:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c6b9b9-7ae4-4257-9203-38a36dba8937]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:54 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a Nov 02 10:08:54 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:55 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a" returned: 0 in 0.584s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:55 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 Nov 02 10:08:55 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:55 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6" returned: 0 in 0.473s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:55 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6 Nov 02 10:08:55 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:55 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a.b2727045-70a7-4a48-9510-ed66eea885d6" returned: 0 in 0.295s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-quobyte-b2727045-70a7-4a48-9510-ed66eea885d6" released by "_delete_snapshot" :: held 2.102s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-quobyte-ce636271-64c7-4722-a822-1d54be98597a" released by "delete_snapshot" :: held 2.136s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:55 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Created reservations ['d0b8d45b-12e9-4a5a-818e-f751b69877f0', 'ad908983-9d05-4b24-b15e-ea01f06ecf0d', '12b8cf08-0195-47d2-93d4-75f93318cd32', '99147875-768b-42b4-b5b2-b4a9a9306cf7'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Delete snapshot completed successfully. Nov 02 10:08:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef472f28-73aa-4282-a1c7-def41a6cbb24 tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-b2727045-70a7-4a48-9510-ed66eea885d6-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Acquiring lock "cinder-ce636271-64c7-4722-a822-1d54be98597a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-ce636271-64c7-4722-a822-1d54be98597a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Acquiring lock "cinder-quobyte-ce636271-64c7-4722-a822-1d54be98597a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:08:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-quobyte-ce636271-64c7-4722-a822-1d54be98597a" acquired by "delete_volume" :: waited 0.076s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:08:57 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb3169b-b8fb-4e51-8fb2-832101a2eadb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:08:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:57 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a Nov 02 10:08:57 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:57 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a" returned: 0 in 0.566s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:57 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a Nov 02 10:08:57 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:08:58 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Nov 02 10:08:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ce636271-64c7-4722-a822-1d54be98597a" returned: 0 in 0.656s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:08:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-quobyte-ce636271-64c7-4722-a822-1d54be98597a" released by "delete_volume" :: held 1.385s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:08:58 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Created reservations ['56447fe8-ce9d-41f6-9dcc-857c0abad7e6', 'ffb3adba-7ec7-4ca2-bb04-01c77a7c374a', 'ca4085c7-86fb-40c1-a634-4c7ef5ebf263', 'acc244c5-8b22-4c55-a0ea-09746f46c1a3'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:08:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:08:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:08:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:08:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:08:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:08:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:08:59 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:08:59 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:00 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.954s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:00 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Deleted volume successfully. Nov 02 10:09:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54e9a003-8753-4df9-8373-b1545a899f6b tempest-VolumeSnapshotQuotasNegativeTestJSON-317443257 None] Lock "cinder-ce636271-64c7-4722-a822-1d54be98597a-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-2897f22f-cd7d-41c7-9db5-14eb5b309807 req-2b6ec901-face-4f7f-8d85-afc585a3a62d tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-2897f22f-cd7d-41c7-9db5-14eb5b309807 req-2b6ec901-face-4f7f-8d85-afc585a3a62d tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-2897f22f-cd7d-41c7-9db5-14eb5b309807 req-2b6ec901-face-4f7f-8d85-afc585a3a62d tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-2897f22f-cd7d-41c7-9db5-14eb5b309807 req-2b6ec901-face-4f7f-8d85-afc585a3a62d tempest-TestServerVolumeAttachmentScenario-1409586647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b99c20a-5b38-45a1-a741-49dab5c11243', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:09:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-2897f22f-cd7d-41c7-9db5-14eb5b309807 req-2b6ec901-face-4f7f-8d85-afc585a3a62d tempest-TestServerVolumeAttachmentScenario-1409586647 None] attachment_update completed successfully. Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Flow 'volume_create_manager' (3ed4c54c-bdf9-4563-8b9c-ef82a48581a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613dd39f-3899-46d0-bb79-b1b6383d7c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613dd39f-3899-46d0-bb79-b1b6383d7c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1205032142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c76da5-f377-46d9-b19a-375187bac85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d977a2abbfa245e699644d093e842f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:14Z,use_quota=True,user_id='88129236ba004dbdb3020cb4581cf4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10c35f23-985d-4626-ba3b-801a1fa83c46),volume_type_id=10c35f23-985d-4626-ba3b-801a1fa83c46)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56326325-31ef-4511-8752-5120fe5a0d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56326325-31ef-4511-8752-5120fe5a0d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f16c18f-8fc8-4da4-871b-47c2f5506891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f16c18f-8fc8-4da4-871b-47c2f5506891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c76da5-f377-46d9-b19a-375187bac85a', 'volume_name': 'volume-70c76da5-f377-46d9-b19a-375187bac85a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae48b5c-f2b3-4144-b8cc-81712f6bec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae48b5c-f2b3-4144-b8cc-81712f6bec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a290add0-11f5-4ac1-855b-d9d7c74e220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:14 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Volume 70c76da5-f377-46d9-b19a-375187bac85a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c76da5-f377-46d9-b19a-375187bac85a', 'volume_size': 1} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1205032142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c76da5-f377-46d9-b19a-375187bac85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d977a2abbfa245e699644d093e842f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:14Z,use_quota=True,user_id='88129236ba004dbdb3020cb4581cf4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10c35f23-985d-4626-ba3b-801a1fa83c46),volume_type_id=10c35f23-985d-4626-ba3b-801a1fa83c46)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Creating volume 70c76da5-f377-46d9-b19a-375187bac85a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:14 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:09:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:14 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a 1073741824 Nov 02 10:09:14 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:15 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a 1073741824" returned: 0 in 0.757s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:15 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a Nov 02 10:09:15 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-fb8b5337-a6f8-4cff-be4b-257399bf4b25 req-8298cb43-aafa-4db1-ba3b-e74d9e4fb4be tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:15 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a" returned: 0 in 0.316s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-fb8b5337-a6f8-4cff-be4b-257399bf4b25 req-8298cb43-aafa-4db1-ba3b-e74d9e4fb4be tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.129s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a290add0-11f5-4ac1-855b-d9d7c74e220b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c76da5-f377-46d9-b19a-375187bac85a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59733f5b-3d5f-459f-ac51-5bbf7935316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-fb8b5337-a6f8-4cff-be4b-257399bf4b25 req-8298cb43-aafa-4db1-ba3b-e74d9e4fb4be tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:15 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Volume volume-70c76da5-f377-46d9-b19a-375187bac85a (70c76da5-f377-46d9-b19a-375187bac85a): created successfully Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59733f5b-3d5f-459f-ac51-5bbf7935316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Flow 'volume_create_manager' (3ed4c54c-bdf9-4563-8b9c-ef82a48581a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-39ca36b5-3755-47d4-aaae-b7796eb7dc36 tempest-VolumeTypesAccessTest-41752126 None] Created volume successfully. Nov 02 10:09:15 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-fb8b5337-a6f8-4cff-be4b-257399bf4b25 req-8298cb43-aafa-4db1-ba3b-e74d9e4fb4be tempest-TestServerVolumeAttachmentScenario-1409586647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73a5ab6e-089f-46d6-a00e-a03c5baba7c2', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:09:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-fb8b5337-a6f8-4cff-be4b-257399bf4b25 req-8298cb43-aafa-4db1-ba3b-e74d9e4fb4be tempest-TestServerVolumeAttachmentScenario-1409586647 None] attachment_update completed successfully. Nov 02 10:09:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Acquiring lock "cinder-70c76da5-f377-46d9-b19a-375187bac85a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Lock "cinder-70c76da5-f377-46d9-b19a-375187bac85a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Acquiring lock "cinder-quobyte-70c76da5-f377-46d9-b19a-375187bac85a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Lock "cinder-quobyte-70c76da5-f377-46d9-b19a-375187bac85a" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:16 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5f2055-2314-4dfe-ad5b-9f4cebf1118a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:16 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a Nov 02 10:09:16 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:16 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a" returned: 0 in 0.466s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:16 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a Nov 02 10:09:16 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:17 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-70c76da5-f377-46d9-b19a-375187bac85a" returned: 0 in 0.303s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Lock "cinder-quobyte-70c76da5-f377-46d9-b19a-375187bac85a" released by "delete_volume" :: held 0.831s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:17 devstack cinder-volume[86840]: WARNING cinder.quota [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-343351934 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-343351934, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:09:17 devstack cinder-volume[86840]: WARNING cinder.quota [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-343351934 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-343351934, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Created reservations ['69187344-1246-4153-a642-8e03fc74d7b9', '91e137dc-d4cb-4abe-8545-ca694547d6fd', 'b3d057b8-4d3a-462b-b12a-d41234adf49f', 'd0c2e3d4-bc29-4311-998e-eecefc6c9c35'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:17 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:09:17 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:17 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.420s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Deleted volume successfully. Nov 02 10:09:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a1d4c534-4afa-4aed-af2f-d3ebbc112475 tempest-VolumeTypesAccessTest-41752126 None] Lock "cinder-70c76da5-f377-46d9-b19a-375187bac85a-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:18 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-32dc658c-6384-4c92-907d-43009e517b60 req-17aa9012-d679-424a-b007-b0e389957f82 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Terminate volume connection completed successfully. Nov 02 10:09:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-32dc658c-6384-4c92-907d-43009e517b60 req-17aa9012-d679-424a-b007-b0e389957f82 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Deleting attachment 73a5ab6e-089f-46d6-a00e-a03c5baba7c2. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:09:20 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-5add0398-328a-46d3-9f47-7c068715716f req-0b3a0d2b-ca71-407d-baf6-fe77d45a278f tempest-TestServerVolumeAttachmentScenario-1409586647 None] Terminate volume connection completed successfully. Nov 02 10:09:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-5add0398-328a-46d3-9f47-7c068715716f req-0b3a0d2b-ca71-407d-baf6-fe77d45a278f tempest-TestServerVolumeAttachmentScenario-1409586647 None] Deleting attachment 0b99c20a-5b38-45a1-a741-49dab5c11243. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:09:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:09:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:20 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:09:20 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:21 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.434s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:09:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:09:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:09:25 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=55,cinder:SELECT=44,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=57,cinder:UPDATE=44,cinder:DELETE=5,cinder:INSERT=6 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Flow 'volume_create_manager' (33159df5-8a8f-46a0-a651-59ef03060846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba105c-86c5-4021-a49a-dad2c673922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba105c-86c5-4021-a49a-dad2c673922c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1534339316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1309a0ed-d7fe-4c22-923f-ec3125a02c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56519c65cb29418ea2e5a9473cc7eaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:26Z,use_quota=True,user_id='8fd2c29577584672a9fd2fe7c23f0c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed50a50b-7290-4f98-98ed-01ad72d60688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed50a50b-7290-4f98-98ed-01ad72d60688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf495534-3c03-4e28-a390-c92084ab3a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf495534-3c03-4e28-a390-c92084ab3a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1309a0ed-d7fe-4c22-923f-ec3125a02c32', 'volume_name': 'volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571b896c-c498-42fa-aba7-8439ef2999be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571b896c-c498-42fa-aba7-8439ef2999be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d8a0dc-cbe8-4835-b6e5-ab53e24e8a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:26 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Volume 1309a0ed-d7fe-4c22-923f-ec3125a02c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32', 'volume_size': 1} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1534339316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1309a0ed-d7fe-4c22-923f-ec3125a02c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56519c65cb29418ea2e5a9473cc7eaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:26Z,use_quota=True,user_id='8fd2c29577584672a9fd2fe7c23f0c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Creating volume 1309a0ed-d7fe-4c22-923f-ec3125a02c32 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:26 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:09:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:26 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 1073741824 Nov 02 10:09:26 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:27 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 1073741824" returned: 0 in 1.147s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:27 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 Nov 02 10:09:27 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:28 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32" returned: 0 in 0.539s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d8a0dc-cbe8-4835-b6e5-ab53e24e8a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a1f542-2cfc-4008-95c7-f632ea376812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:28 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Volume volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 (1309a0ed-d7fe-4c22-923f-ec3125a02c32): created successfully Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a1f542-2cfc-4008-95c7-f632ea376812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Flow 'volume_create_manager' (33159df5-8a8f-46a0-a651-59ef03060846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b1970788-3640-4904-acf9-2ceb741c2555 tempest-AttachVolumeTestJSON-12520340 None] Created volume successfully. Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "cinder-9f52f0a9-be1e-43fe-a771-49f9c0f46282-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "cinder-9f52f0a9-be1e-43fe-a771-49f9c0f46282-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "cinder-quobyte-9f52f0a9-be1e-43fe-a771-49f9c0f46282" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "cinder-quobyte-9f52f0a9-be1e-43fe-a771-49f9c0f46282" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:29 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e06a9e5-5fae-4cd5-8917-6dca2195292a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:29 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 Nov 02 10:09:29 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:29 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282" returned: 0 in 0.518s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:29 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282 Nov 02 10:09:29 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:30 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9f52f0a9-be1e-43fe-a771-49f9c0f46282" returned: 0 in 0.783s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "cinder-quobyte-9f52f0a9-be1e-43fe-a771-49f9c0f46282" released by "delete_volume" :: held 1.387s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:30 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Created reservations ['6204ff2d-dfae-40cf-8da1-5e31797d76f4', '7fca9949-1bcd-4697-b75c-856e357550b9', 'f63e84ec-a46c-4fae-9d15-8bf2d1c7e0d6', '7cef3f9c-98b9-468c-acca-d23f8879c91e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:30 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:09:30 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-aa172358-5643-4362-b8d9-fcec4cc26389 req-8580ca9a-b216-42d6-b55d-d90280c68c95 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-aa172358-5643-4362-b8d9-fcec4cc26389 req-8580ca9a-b216-42d6-b55d-d90280c68c95 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-aa172358-5643-4362-b8d9-fcec4cc26389 req-8580ca9a-b216-42d6-b55d-d90280c68c95 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-aa172358-5643-4362-b8d9-fcec4cc26389 req-8580ca9a-b216-42d6-b55d-d90280c68c95 tempest-AttachVolumeTestJSON-12520340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bee790f-4811-4d6c-8361-031c1f14a040', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:09:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-aa172358-5643-4362-b8d9-fcec4cc26389 req-8580ca9a-b216-42d6-b55d-d90280c68c95 tempest-AttachVolumeTestJSON-12520340 None] attachment_update completed successfully. Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "cinder-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:31 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.664s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Deleted volume successfully. Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "cinder-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-71cc4074-c10f-429a-af01-f1be80b8b33b tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "cinder-9f52f0a9-be1e-43fe-a771-49f9c0f46282-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "cinder-quobyte-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "cinder-quobyte-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd" acquired by "delete_volume" :: waited 0.056s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[66554d0c-cc6b-4c19-a89f-d87e1efd3238]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:32 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd Nov 02 10:09:32 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:32 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd" returned: 0 in 0.649s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:32 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd Nov 02 10:09:32 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:33 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd" returned: 0 in 0.653s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Flow 'volume_create_manager' (92cce0aa-2ac4-4244-acee-8796a1def6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bf4468-d2e1-48b4-9da4-f4e41fe95221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "cinder-quobyte-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd" released by "delete_volume" :: held 1.469s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bf4468-d2e1-48b4-9da4-f4e41fe95221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-293741001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c9f015-46fe-4fb7-8a59-c26d5fee8279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06692a9d7ed7425391a09b1f3414847c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:33Z,use_quota=True,user_id='d06bf6962dad4af48b602c65e23b1610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b26b015-068e-4f91-ae96-3d49cb0ca85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b26b015-068e-4f91-ae96-3d49cb0ca85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76a049f-ce51-4446-bdde-f5f56fcedac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76a049f-ce51-4446-bdde-f5f56fcedac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c9f015-46fe-4fb7-8a59-c26d5fee8279', 'volume_name': 'volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005c4f38-5d96-4ad7-883a-3dfc21cb9e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005c4f38-5d96-4ad7-883a-3dfc21cb9e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0200c35-760b-45d4-8572-ecc266515a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:33 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Volume 38c9f015-46fe-4fb7-8a59-c26d5fee8279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279', 'volume_size': 1} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-293741001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c9f015-46fe-4fb7-8a59-c26d5fee8279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06692a9d7ed7425391a09b1f3414847c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:33Z,use_quota=True,user_id='d06bf6962dad4af48b602c65e23b1610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Creating volume 38c9f015-46fe-4fb7-8a59-c26d5fee8279 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:33 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:33 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 1073741824 Nov 02 10:09:33 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Created reservations ['61ff1e95-58ca-4b21-a82e-d03f5a77e6af', '574adbc5-7f9d-43ac-91cf-8eacdafe75f2', 'd9361ab0-60f9-4f2e-a485-c566b09196d7', '68806f64-8a0a-4538-b41b-fde61c6bbceb'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:33 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:09:33 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:33 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.457s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Deleted volume successfully. Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aea07963-a5ed-4128-a259-2ddf3c904a06 tempest-TestServerVolumeAttachmentScenario-1409586647 None] Lock "cinder-b12a17fc-6f61-40f7-a9ce-bfbcbaff58bd-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:34 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 1073741824" returned: 0 in 0.886s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:34 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 Nov 02 10:09:34 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Flow 'volume_create_manager' (bf3bdf1b-868a-4ef6-b3e8-cd08dae2937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a743e1b-fff8-4c42-973b-eb4c48f23ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a743e1b-fff8-4c42-973b-eb4c48f23ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1611908314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8642e23-5686-4633-85c1-df2622905346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56519c65cb29418ea2e5a9473cc7eaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:34Z,use_quota=True,user_id='8fd2c29577584672a9fd2fe7c23f0c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73b352f-70ee-4c3c-89c0-73ec3f2b874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73b352f-70ee-4c3c-89c0-73ec3f2b874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53c5704-f560-4627-ba4c-d65b13050019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53c5704-f560-4627-ba4c-d65b13050019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8642e23-5686-4633-85c1-df2622905346', 'volume_name': 'volume-a8642e23-5686-4633-85c1-df2622905346', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e519c06-c935-412a-bb1c-3844b0bb4e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e519c06-c935-412a-bb1c-3844b0bb4e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c3b8b6-e190-4caf-8878-758d3abc4653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:34 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Volume a8642e23-5686-4633-85c1-df2622905346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8642e23-5686-4633-85c1-df2622905346', 'volume_size': 1} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:34 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279" returned: 0 in 0.405s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1611908314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8642e23-5686-4633-85c1-df2622905346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56519c65cb29418ea2e5a9473cc7eaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:34Z,use_quota=True,user_id='8fd2c29577584672a9fd2fe7c23f0c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Creating volume a8642e23-5686-4633-85c1-df2622905346 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:34 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0200c35-760b-45d4-8572-ecc266515a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:34 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346 1073741824 Nov 02 10:09:34 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f380b2bb-b495-46b5-a458-bdf12c1ea332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:34 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Volume volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 (38c9f015-46fe-4fb7-8a59-c26d5fee8279): created successfully Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f380b2bb-b495-46b5-a458-bdf12c1ea332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Flow 'volume_create_manager' (92cce0aa-2ac4-4244-acee-8796a1def6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f30ca81f-a666-46d8-8b0b-5c134277827e tempest-TestMinimumBasicScenario-477394516 None] Created volume successfully. Nov 02 10:09:35 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346 1073741824" returned: 0 in 0.881s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:35 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346 Nov 02 10:09:35 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:36 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346" returned: 0 in 0.336s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c3b8b6-e190-4caf-8878-758d3abc4653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8642e23-5686-4633-85c1-df2622905346', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b173cc-555c-48a0-97a1-305edc2ba239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:36 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Volume volume-a8642e23-5686-4633-85c1-df2622905346 (a8642e23-5686-4633-85c1-df2622905346): created successfully Nov 02 10:09:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b173cc-555c-48a0-97a1-305edc2ba239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Flow 'volume_create_manager' (bf3bdf1b-868a-4ef6-b3e8-cd08dae2937f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:36 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a74c6815-1cd0-47d2-9b17-8f976af9ebb2 tempest-AttachVolumeTestJSON-12520340 None] Created volume successfully. Nov 02 10:09:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-aec93051-fbd7-4c68-81d0-214f3d37bb6c req-9511cfab-b06a-47bf-bfd7-c820176e5e5e tempest-TestMinimumBasicScenario-477394516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-aec93051-fbd7-4c68-81d0-214f3d37bb6c req-9511cfab-b06a-47bf-bfd7-c820176e5e5e tempest-TestMinimumBasicScenario-477394516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-aec93051-fbd7-4c68-81d0-214f3d37bb6c req-9511cfab-b06a-47bf-bfd7-c820176e5e5e tempest-TestMinimumBasicScenario-477394516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-aec93051-fbd7-4c68-81d0-214f3d37bb6c req-9511cfab-b06a-47bf-bfd7-c820176e5e5e tempest-TestMinimumBasicScenario-477394516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2c01c37-61e7-4684-97e6-75948362482d', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:09:37 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-aec93051-fbd7-4c68-81d0-214f3d37bb6c req-9511cfab-b06a-47bf-bfd7-c820176e5e5e tempest-TestMinimumBasicScenario-477394516 None] attachment_update completed successfully. Nov 02 10:09:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-89a91964-af06-475d-ab52-a1d8b024ea52 req-05a610de-dbe1-40be-b817-947aff83d4dd tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-89a91964-af06-475d-ab52-a1d8b024ea52 req-05a610de-dbe1-40be-b817-947aff83d4dd tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-89a91964-af06-475d-ab52-a1d8b024ea52 req-05a610de-dbe1-40be-b817-947aff83d4dd tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-89a91964-af06-475d-ab52-a1d8b024ea52 req-05a610de-dbe1-40be-b817-947aff83d4dd tempest-AttachVolumeTestJSON-12520340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-a8642e23-5686-4633-85c1-df2622905346', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c6e0bf0-0a3d-4873-81e2-a6bdf0243c3c', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:09:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-89a91964-af06-475d-ab52-a1d8b024ea52 req-05a610de-dbe1-40be-b817-947aff83d4dd tempest-AttachVolumeTestJSON-12520340 None] attachment_update completed successfully. Nov 02 10:09:41 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-6e88431b-82c6-40e0-a479-6bfa5cec2d46 req-0093077d-6987-4eed-8353-82006ff4999f tempest-AttachVolumeTestJSON-12520340 None] Terminate volume connection completed successfully. Nov 02 10:09:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-6e88431b-82c6-40e0-a479-6bfa5cec2d46 req-0093077d-6987-4eed-8353-82006ff4999f tempest-AttachVolumeTestJSON-12520340 None] Deleting attachment 2bee790f-4811-4d6c-8361-031c1f14a040. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:09:43 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-9ec9a557-0859-4560-a56a-e20b222a0314 req-30de9c63-a715-47f2-b89a-9f45c5a43196 tempest-AttachVolumeTestJSON-12520340 None] Terminate volume connection completed successfully. Nov 02 10:09:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-9ec9a557-0859-4560-a56a-e20b222a0314 req-30de9c63-a715-47f2-b89a-9f45c5a43196 tempest-AttachVolumeTestJSON-12520340 None] Deleting attachment 2c6e0bf0-0a3d-4873-81e2-a6bdf0243c3c. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:09:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "cinder-a8642e23-5686-4633-85c1-df2622905346-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-a8642e23-5686-4633-85c1-df2622905346-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "cinder-quobyte-a8642e23-5686-4633-85c1-df2622905346" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-quobyte-a8642e23-5686-4633-85c1-df2622905346" acquired by "delete_volume" :: waited 0.042s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97a25d-582e-4ae8-a9bf-d71cc0ed3ab9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:53 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346 Nov 02 10:09:53 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:54 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346" returned: 0 in 0.590s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:54 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346 Nov 02 10:09:54 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:54 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a8642e23-5686-4633-85c1-df2622905346" returned: 0 in 0.482s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-quobyte-a8642e23-5686-4633-85c1-df2622905346" released by "delete_volume" :: held 1.182s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:54 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Created reservations ['2ac033a1-3e17-48fd-9d80-93f293266212', '5d6deed9-c5f5-46c6-aa2e-8710f7c8409d', '857e4a5d-37a7-4725-8b34-30aa6e0e4de0', 'd562c96e-6ba4-457a-9e06-8c667af4df74'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:55 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:09:55 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:55 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.430s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:55 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Deleted volume successfully. Nov 02 10:09:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be5c8cec-4c43-4941-8c62-9873e9f78306 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-a8642e23-5686-4633-85c1-df2622905346-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "cinder-1309a0ed-d7fe-4c22-923f-ec3125a02c32-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-1309a0ed-d7fe-4c22-923f-ec3125a02c32-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "cinder-quobyte-1309a0ed-d7fe-4c22-923f-ec3125a02c32" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-quobyte-1309a0ed-d7fe-4c22-923f-ec3125a02c32" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:56 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3610ae5e-cf63-4d1c-83e5-4298f168332e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:56 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 Nov 02 10:09:56 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:56 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32" returned: 0 in 0.612s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:56 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32 Nov 02 10:09:56 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:57 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1309a0ed-d7fe-4c22-923f-ec3125a02c32" returned: 0 in 0.405s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-quobyte-1309a0ed-d7fe-4c22-923f-ec3125a02c32" released by "delete_volume" :: held 1.114s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Created reservations ['8e95cea8-43f3-46ac-b449-e141b38484d1', 'ec62c2e0-8335-479a-ba88-a73a96642fb0', '4b8263e2-bd42-41b4-bed0-1644e1a55b99', '5f5e3fec-07f0-44c5-9365-7c1c458a1041'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:57 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:09:57 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "cinder-81a0f831-8847-423b-8d0c-1bcad13ebc23-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-81a0f831-8847-423b-8d0c-1bcad13ebc23-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:58 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.486s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:09:58 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Deleted volume successfully. Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (f384f5b1-334c-452e-8c8b-9d8e233d93be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f3bb37-a998-433b-a0a5-4093859aaf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "cinder-quobyte-81a0f831-8847-423b-8d0c-1bcad13ebc23" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f3bb37-a998-433b-a0a5-4093859aaf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886635622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1068fc3-99b2-4d6d-8e6e-dd63cce6de51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:58Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4369f415-0900-4d1e-bf2b-540f28d75248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4369f415-0900-4d1e-bf2b-540f28d75248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0aa5430-e6a7-4c03-80c3-e8234ddd6501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0aa5430-e6a7-4c03-80c3-e8234ddd6501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1068fc3-99b2-4d6d-8e6e-dd63cce6de51', 'volume_name': 'volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fbcdeb-eb04-4f06-83af-696a17269f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fbcdeb-eb04-4f06-83af-696a17269f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13392fd-2599-4419-8092-9640583d8e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Volume d1068fc3-99b2-4d6d-8e6e-dd63cce6de51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51', 'volume_size': 1} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1886635622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1068fc3-99b2-4d6d-8e6e-dd63cce6de51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:58Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Creating volume d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:58 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-quobyte-81a0f831-8847-423b-8d0c-1bcad13ebc23" acquired by "delete_volume" :: waited 0.095s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-08184fcd-86ff-4c14-8d7e-db459be8b282 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-1309a0ed-d7fe-4c22-923f-ec3125a02c32-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:58 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 1073741824 Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b1ead-c3d2-40c2-83a2-d5237def7897]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:58 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:58 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 Nov 02 10:09:58 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Flow 'volume_create_manager' (7d2b3d2f-7cfd-46aa-a463-b30ca53634e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb05c47d-f6dd-420c-980c-188bad8e05d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb05c47d-f6dd-420c-980c-188bad8e05d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-491743227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb9f81a-8d24-4bea-889b-344f63270f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3781453bbe6a457aaffe43449f355f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:58Z,use_quota=True,user_id='6fc8cf1214ce41be934ad082f6224a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e014d4f7-66aa-4567-a52b-24f2d89e281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e014d4f7-66aa-4567-a52b-24f2d89e281f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa187560-69a3-40c6-b2df-53dba260f6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa187560-69a3-40c6-b2df-53dba260f6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb9f81a-8d24-4bea-889b-344f63270f31', 'volume_name': 'volume-deb9f81a-8d24-4bea-889b-344f63270f31', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7865eabd-1836-49fd-a247-f0a9098ca2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7865eabd-1836-49fd-a247-f0a9098ca2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ad2c35-5750-4d66-aef4-0bc2672b57e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Volume deb9f81a-8d24-4bea-889b-344f63270f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb9f81a-8d24-4bea-889b-344f63270f31', 'volume_size': 1} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (852e19d3-84b3-4952-80ce-d073399fce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bf6903-8965-40c0-8aec-5bead32a373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bf6903-8965-40c0-8aec-5bead32a373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611998928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4e00e0-8ff1-4181-afca-f841cd17cfa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:59Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3aef75e-c6c6-496e-9cb7-e512d8b383d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3aef75e-c6c6-496e-9cb7-e512d8b383d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404b824c-fcad-4dee-8f74-c74be4ebc646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404b824c-fcad-4dee-8f74-c74be4ebc646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4e00e0-8ff1-4181-afca-f841cd17cfa5', 'volume_name': 'volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979cabc7-1e71-4b16-94e5-23086b52630e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979cabc7-1e71-4b16-94e5-23086b52630e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7e0c8d-81ec-41e6-ae74-78ae5e4ccb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Volume 4e4e00e0-8ff1-4181-afca-f841cd17cfa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5', 'volume_size': 1} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:58 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23" returned: 0 in 0.564s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:58 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23 Nov 02 10:09:58 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (4d2ffd47-4a82-4db2-b548-3613322cc80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bdb40d-cf1e-4b99-9594-dd839b429a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:58 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 1073741824" returned: 0 in 0.753s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bdb40d-cf1e-4b99-9594-dd839b429a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1919445741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b4cb9e-f9c2-46db-a4f4-6752f6776a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:59Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f346e53-be72-45e7-8a77-4481a45fb4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f346e53-be72-45e7-8a77-4481a45fb4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d10fd0-db7e-475e-81f7-7c5662c2f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d10fd0-db7e-475e-81f7-7c5662c2f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b4cb9e-f9c2-46db-a4f4-6752f6776a23', 'volume_name': 'volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6717590-5f28-485f-8825-37058cb574a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6717590-5f28-485f-8825-37058cb574a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562b2616-5b72-4540-8dd7-d8335a68358e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Volume b2b4cb9e-f9c2-46db-a4f4-6752f6776a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23', 'volume_size': 1} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:59 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 Nov 02 10:09:59 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:59 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-81a0f831-8847-423b-8d0c-1bcad13ebc23" returned: 0 in 0.397s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-quobyte-81a0f831-8847-423b-8d0c-1bcad13ebc23" released by "delete_volume" :: held 1.035s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Created reservations ['04259c3b-2bd4-4028-9e91-cf23e5647081', '84d98d46-036a-42cf-9f15-4d97ed8f95a5', 'ba8160fc-5dd5-4203-8f0e-53adefc5c2a8', '9ef2d358-c832-497d-8706-8de8d635ad3d'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (0732c977-a99f-4d22-8f41-e597d48478cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db534cf-bb9c-45bd-8430-8eefe83ad26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db534cf-bb9c-45bd-8430-8eefe83ad26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108230001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c2fedd-9785-4f50-8587-72759b5ef414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:59Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914c1e04-2ec4-4818-8389-394b9fde9e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914c1e04-2ec4-4818-8389-394b9fde9e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7e7fc2-d711-46c0-ac0a-382cf75ecdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7e7fc2-d711-46c0-ac0a-382cf75ecdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c2fedd-9785-4f50-8587-72759b5ef414', 'volume_name': 'volume-a5c2fedd-9785-4f50-8587-72759b5ef414', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4885ce-e2a0-4558-8db2-9dda73aa5f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4885ce-e2a0-4558-8db2-9dda73aa5f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95f9e79-05c4-4e1d-bf1b-1efef483ffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Volume a5c2fedd-9785-4f50-8587-72759b5ef414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c2fedd-9785-4f50-8587-72759b5ef414', 'volume_size': 1} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51" returned: 0 in 0.497s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-491743227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb9f81a-8d24-4bea-889b-344f63270f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3781453bbe6a457aaffe43449f355f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:58Z,use_quota=True,user_id='6fc8cf1214ce41be934ad082f6224a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Creating volume deb9f81a-8d24-4bea-889b-344f63270f31 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:09:59 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:09:59 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31 1073741824 Nov 02 10:09:59 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13392fd-2599-4419-8092-9640583d8e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a11dbcf-91a9-4a8b-baf8-1a2f2ab8cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:09:59 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:09:59 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:09:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Volume volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 (d1068fc3-99b2-4d6d-8e6e-dd63cce6de51): created successfully Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a11dbcf-91a9-4a8b-baf8-1a2f2ab8cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:09:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (f384f5b1-334c-452e-8c8b-9d8e233d93be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:09:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-165ae1a9-dc91-401d-8004-f1e029ae8fb8 tempest-CreateVolumesFromImageTest-1232120650 None] Created volume successfully. Nov 02 10:10:00 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.358s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Deleted volume successfully. Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-753e09f0-260a-401d-a5bb-4e9f49a25034 tempest-AttachVolumeTestJSON-12520340 None] Lock "cinder-81a0f831-8847-423b-8d0c-1bcad13ebc23-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (7d810aa1-99f8-47ea-8797-0fe60f6516de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383575ff-e18d-49a0-8b02-ca60baa72519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383575ff-e18d-49a0-8b02-ca60baa72519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2129552649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066b30a8-0d78-40fb-804d-0781c82964e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:00Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fb3988-2e54-4f47-9572-c3b8395a06c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fb3988-2e54-4f47-9572-c3b8395a06c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f98f41a-2808-4d3e-849d-00d43dca2817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f98f41a-2808-4d3e-849d-00d43dca2817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066b30a8-0d78-40fb-804d-0781c82964e0', 'volume_name': 'volume-066b30a8-0d78-40fb-804d-0781c82964e0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93813bc1-a3c4-468c-ad8a-1f4a0dbb53d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93813bc1-a3c4-468c-ad8a-1f4a0dbb53d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0f9b43-fc90-447a-8db4-84b0d30c99d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:00 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Volume 066b30a8-0d78-40fb-804d-0781c82964e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066b30a8-0d78-40fb-804d-0781c82964e0', 'volume_size': 1} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:00 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31 1073741824" returned: 0 in 0.778s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:00 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31 Nov 02 10:10:00 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:00 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31" returned: 0 in 0.294s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1611998928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4e00e0-8ff1-4181-afca-f841cd17cfa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:59Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Creating volume 4e4e00e0-8ff1-4181-afca-f841cd17cfa5 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:00 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ad2c35-5750-4d66-aef4-0bc2672b57e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb9f81a-8d24-4bea-889b-344f63270f31', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f2a79c-d604-44ec-a0e1-f4e3c979a461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:00 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 1073741824 Nov 02 10:10:00 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:00 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Volume volume-deb9f81a-8d24-4bea-889b-344f63270f31 (deb9f81a-8d24-4bea-889b-344f63270f31): created successfully Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f2a79c-d604-44ec-a0e1-f4e3c979a461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Flow 'volume_create_manager' (7d2b3d2f-7cfd-46aa-a463-b30ca53634e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c075292b-6a56-42a8-8d5e-72f841928ca8 tempest-VolumesListAdminTestJSON-1549627232 None] Created volume successfully. Nov 02 10:10:01 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 1073741824" returned: 0 in 0.573s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:01 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 Nov 02 10:10:01 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:01 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5" returned: 0 in 0.437s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.824s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1919445741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b4cb9e-f9c2-46db-a4f4-6752f6776a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:59Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Creating volume b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:01 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:01 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 1073741824 Nov 02 10:10:01 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7e0c8d-81ec-41e6-ae74-78ae5e4ccb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef07d26-b683-4d04-9c01-c7ffbf1da111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Volume volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 (4e4e00e0-8ff1-4181-afca-f841cd17cfa5): created successfully Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef07d26-b683-4d04-9c01-c7ffbf1da111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (852e19d3-84b3-4952-80ce-d073399fce06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Flow 'volume_create_manager' (ca6d862b-76e2-4881-ade2-cb5c8355a736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcbd60b-cf5f-46b3-8a4b-aa7b4ce5a231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-96e7a95b-3a92-46f8-8725-4ca3b009af58 tempest-CreateVolumesFromImageTest-1232120650 None] Created volume successfully. Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcbd60b-cf5f-46b3-8a4b-aa7b4ce5a231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-732746355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3781453bbe6a457aaffe43449f355f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:02Z,use_quota=True,user_id='6fc8cf1214ce41be934ad082f6224a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96535c65-1771-4923-a42d-507c60617b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96535c65-1771-4923-a42d-507c60617b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472b7af8-2606-4e0c-82bd-63d19dc622eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472b7af8-2606-4e0c-82bd-63d19dc622eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5', 'volume_name': 'volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f879df-1335-40bd-b9df-f4d4398409c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f879df-1335-40bd-b9df-f4d4398409c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc23e0a-65bc-4c44-9c92-050705d49ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Volume 914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5', 'volume_size': 1} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:02 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 1073741824" returned: 0 in 0.566s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:02 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 Nov 02 10:10:02 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:02 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23" returned: 0 in 0.409s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.320s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108230001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c2fedd-9785-4f50-8587-72759b5ef414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:59Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Creating volume a5c2fedd-9785-4f50-8587-72759b5ef414 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:03 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562b2616-5b72-4540-8dd7-d8335a68358e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffbe549-bf39-46a2-a742-5c9f67df59db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:03 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414 1073741824 Nov 02 10:10:03 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:03 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Volume volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 (b2b4cb9e-f9c2-46db-a4f4-6752f6776a23): created successfully Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffbe549-bf39-46a2-a742-5c9f67df59db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (4d2ffd47-4a82-4db2-b548-3613322cc80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1c89bd52-a410-4caf-9ce7-f7b759172977 tempest-CreateVolumesFromImageTest-1232120650 None] Created volume successfully. Nov 02 10:10:03 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414 1073741824" returned: 0 in 0.592s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:03 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414 Nov 02 10:10:03 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:03 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414" returned: 0 in 0.294s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.512s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2129552649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066b30a8-0d78-40fb-804d-0781c82964e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77746d1d400849888fe76f6d788f4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:00Z,use_quota=True,user_id='6cdf2a6b0c024406a47400345541cd9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Creating volume 066b30a8-0d78-40fb-804d-0781c82964e0 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:03 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:10:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95f9e79-05c4-4e1d-bf1b-1efef483ffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c2fedd-9785-4f50-8587-72759b5ef414', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f70409-3b9b-4af5-a50f-b16a7c437377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:04 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0 1073741824 Nov 02 10:10:04 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:04 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Volume volume-a5c2fedd-9785-4f50-8587-72759b5ef414 (a5c2fedd-9785-4f50-8587-72759b5ef414): created successfully Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f70409-3b9b-4af5-a50f-b16a7c437377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (0732c977-a99f-4d22-8f41-e597d48478cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0046be01-919a-497c-8094-cc784ae9de71 tempest-CreateVolumesFromImageTest-1232120650 None] Created volume successfully. Nov 02 10:10:04 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0 1073741824" returned: 0 in 0.547s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:04 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0 Nov 02 10:10:04 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:04 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0" returned: 0 in 0.345s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.766s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-732746355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3781453bbe6a457aaffe43449f355f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:02Z,use_quota=True,user_id='6fc8cf1214ce41be934ad082f6224a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Creating volume 914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:04 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0f9b43-fc90-447a-8db4-84b0d30c99d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066b30a8-0d78-40fb-804d-0781c82964e0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecd8b4c-ab2a-4a69-b844-0265681e22ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:04 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 1073741824 Nov 02 10:10:04 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:04 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Volume volume-066b30a8-0d78-40fb-804d-0781c82964e0 (066b30a8-0d78-40fb-804d-0781c82964e0): created successfully Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecd8b4c-ab2a-4a69-b844-0265681e22ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Flow 'volume_create_manager' (7d810aa1-99f8-47ea-8797-0fe60f6516de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-12da7f2c-e9f2-4173-b1ec-3e83c09d2059 tempest-CreateVolumesFromImageTest-1232120650 None] Created volume successfully. Nov 02 10:10:05 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 1073741824" returned: 0 in 0.667s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:05 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 Nov 02 10:10:05 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-066b30a8-0d78-40fb-804d-0781c82964e0-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:06 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-066b30a8-0d78-40fb-804d-0781c82964e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5" returned: 0 in 0.375s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc23e0a-65bc-4c44-9c92-050705d49ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80411fad-2808-498f-bf51-1854b8192924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:06 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Volume volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 (914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5): created successfully Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80411fad-2808-498f-bf51-1854b8192924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Flow 'volume_create_manager' (ca6d862b-76e2-4881-ade2-cb5c8355a736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-quobyte-066b30a8-0d78-40fb-804d-0781c82964e0" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-35ee1cc2-d0b9-4340-b658-6e71ada65e4e tempest-VolumesListAdminTestJSON-1549627232 None] Created volume successfully. Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-066b30a8-0d78-40fb-804d-0781c82964e0" acquired by "delete_volume" :: waited 0.039s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c8fd3-dc0c-404b-885b-c67cf4269918]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:06 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0 Nov 02 10:10:06 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:06 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0" returned: 0 in 0.510s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:06 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0 Nov 02 10:10:06 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Flow 'volume_create_manager' (4c8d020e-7957-4341-b9ce-9ffaee13a7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece11f25-ab65-464a-ba58-bc8ad1856a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece11f25-ab65-464a-ba58-bc8ad1856a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1726451226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435ac11f-aa75-4116-81fe-41c139daaa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3781453bbe6a457aaffe43449f355f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:07Z,use_quota=True,user_id='6fc8cf1214ce41be934ad082f6224a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcc85af-13c7-451a-b661-650c7bbec7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcc85af-13c7-451a-b661-650c7bbec7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277c24b5-b310-4558-9acf-28277c2161c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277c24b5-b310-4558-9acf-28277c2161c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '435ac11f-aa75-4116-81fe-41c139daaa51', 'volume_name': 'volume-435ac11f-aa75-4116-81fe-41c139daaa51', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37feafa1-bb75-46b5-b95b-662ae62a0a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37feafa1-bb75-46b5-b95b-662ae62a0a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bb8a74-0aab-4c9d-8d69-1a90ff4cbfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:06 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Volume 435ac11f-aa75-4116-81fe-41c139daaa51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-435ac11f-aa75-4116-81fe-41c139daaa51', 'volume_size': 1} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1726451226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435ac11f-aa75-4116-81fe-41c139daaa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3781453bbe6a457aaffe43449f355f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:07Z,use_quota=True,user_id='6fc8cf1214ce41be934ad082f6224a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Creating volume 435ac11f-aa75-4116-81fe-41c139daaa51 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:07 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:07 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-066b30a8-0d78-40fb-804d-0781c82964e0" returned: 0 in 0.312s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:07 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51 1073741824 Nov 02 10:10:07 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-066b30a8-0d78-40fb-804d-0781c82964e0" released by "delete_volume" :: held 0.896s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Created reservations ['7c93315d-f677-4a0e-86e2-c97517d4e2e5', '22aa1db3-8a91-4540-b813-d6db1fa910a0', '52468c58-d566-4e21-8336-dd5d0f99bbb7', '59177cfa-5525-4e4e-9f8f-2a1ab45b788f'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:07 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:07 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:07 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51 1073741824" returned: 0 in 0.640s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:07 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.405s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Deleted volume successfully. Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2937a0a3-ce9c-4fa1-97fa-2cd352d3c22a tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-066b30a8-0d78-40fb-804d-0781c82964e0-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:07 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51 Nov 02 10:10:07 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:08 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51" returned: 0 in 0.310s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bb8a74-0aab-4c9d-8d69-1a90ff4cbfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435ac11f-aa75-4116-81fe-41c139daaa51', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f55f0c8-3f81-434f-af63-4038fca1a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Volume volume-435ac11f-aa75-4116-81fe-41c139daaa51 (435ac11f-aa75-4116-81fe-41c139daaa51): created successfully Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f55f0c8-3f81-434f-af63-4038fca1a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Flow 'volume_create_manager' (4c8d020e-7957-4341-b9ce-9ffaee13a7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ac279f58-4cad-43a8-82ad-412a0d7492f5 tempest-VolumesListAdminTestJSON-1549627232 None] Created volume successfully. Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-a5c2fedd-9785-4f50-8587-72759b5ef414-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-a5c2fedd-9785-4f50-8587-72759b5ef414-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-quobyte-a5c2fedd-9785-4f50-8587-72759b5ef414" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-a5c2fedd-9785-4f50-8587-72759b5ef414" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe428b-c249-4aaf-801f-dde4d4c261c0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:08 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414 Nov 02 10:10:08 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:08 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414" returned: 0 in 0.535s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:08 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414 Nov 02 10:10:08 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:09 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a5c2fedd-9785-4f50-8587-72759b5ef414" returned: 0 in 0.320s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-a5c2fedd-9785-4f50-8587-72759b5ef414" released by "delete_volume" :: held 0.906s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Created reservations ['de28740b-ae1a-4836-9913-2248b6495466', 'f744d178-b543-421b-b06f-40db0679bdc3', '87ad0057-e021-411a-afc9-2fcd5a4fa1d8', '09776e84-171e-4f4b-b3f0-63cc5d53218c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:09 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:09 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:09 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.358s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Deleted volume successfully. Nov 02 10:10:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e97b64e-66d0-4582-8661-49262a1b4f39 tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-a5c2fedd-9785-4f50-8587-72759b5ef414-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Flow 'volume_create_manager' (cd31dc2d-f587-4331-b084-9ace5d9fe20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db1429b-b8aa-4ea0-af0a-10d4e74f0d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db1429b-b8aa-4ea0-af0a-10d4e74f0d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b241b0-19cc-4783-a2d7-86ac359d80cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bd282ab47a4b74bb53cc7570197b58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:10Z,use_quota=True,user_id='ed814dcc4f5441629a8ebd7097d25659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bf504b-efb4-409f-bacc-52a554054ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bf504b-efb4-409f-bacc-52a554054ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d050b1-0c0d-478c-9e34-e884aca56a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d050b1-0c0d-478c-9e34-e884aca56a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b241b0-19cc-4783-a2d7-86ac359d80cd', 'volume_name': 'volume-23b241b0-19cc-4783-a2d7-86ac359d80cd', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a3a3f2-6738-4988-91d2-ca1719f7b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a3a3f2-6738-4988-91d2-ca1719f7b977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b26f41-dfc7-4fa6-a6ed-94245e6d493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:10 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Volume 23b241b0-19cc-4783-a2d7-86ac359d80cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b241b0-19cc-4783-a2d7-86ac359d80cd', 'volume_size': 1} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b241b0-19cc-4783-a2d7-86ac359d80cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bd282ab47a4b74bb53cc7570197b58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:10Z,use_quota=True,user_id='ed814dcc4f5441629a8ebd7097d25659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Creating volume 23b241b0-19cc-4783-a2d7-86ac359d80cd {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:10 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:10 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd 1073741824 Nov 02 10:10:10 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-quobyte-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[44836a11-257a-467a-961c-4b6a842b0512]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:11 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 Nov 02 10:10:11 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:11 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd 1073741824" returned: 0 in 0.908s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:11 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23" returned: 0 in 0.821s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:11 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23 Nov 02 10:10:11 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd Nov 02 10:10:11 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:11 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:12 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23" returned: 0 in 0.416s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23" released by "delete_volume" :: held 1.300s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:12 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd" returned: 0 in 0.511s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b26f41-dfc7-4fa6-a6ed-94245e6d493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b241b0-19cc-4783-a2d7-86ac359d80cd', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c908ad-de32-4fb1-8d0f-1f6bb93d0546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:12 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Volume volume-23b241b0-19cc-4783-a2d7-86ac359d80cd (23b241b0-19cc-4783-a2d7-86ac359d80cd): created successfully Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c908ad-de32-4fb1-8d0f-1f6bb93d0546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Flow 'volume_create_manager' (cd31dc2d-f587-4331-b084-9ace5d9fe20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Created reservations ['01f626b2-3304-4aeb-b789-db9924235167', '561abfdc-74be-4265-be3b-34d672fb33ab', '1e64014e-e608-4753-a8a9-4fbd91a546d0', '8d926bad-526b-450b-806f-77bccd2e3c3e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:12 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b2b105f9-63b2-4a0a-a65c-27bc32a4a221 tempest-VolumesListAdminTestJSON-735155498 None] Created volume successfully. Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:12 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:12 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Acquiring lock "cinder-23b241b0-19cc-4783-a2d7-86ac359d80cd-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Lock "cinder-23b241b0-19cc-4783-a2d7-86ac359d80cd-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Acquiring lock "cinder-quobyte-23b241b0-19cc-4783-a2d7-86ac359d80cd" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Lock "cinder-quobyte-23b241b0-19cc-4783-a2d7-86ac359d80cd" acquired by "delete_volume" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:12 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.448s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:12 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Deleted volume successfully. Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d96c491-8b9f-4049-b4e6-e3f447cb9194]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b04f9d26-82c4-42f3-bdeb-862512ce85cf tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-b2b4cb9e-f9c2-46db-a4f4-6752f6776a23-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "cinder-435ac11f-aa75-4116-81fe-41c139daaa51-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-435ac11f-aa75-4116-81fe-41c139daaa51-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "cinder-quobyte-435ac11f-aa75-4116-81fe-41c139daaa51" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-quobyte-435ac11f-aa75-4116-81fe-41c139daaa51" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:13 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd Nov 02 10:10:13 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b96612a-4f26-410f-ad0a-2875468acd31]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-4e4e00e0-8ff1-4181-afca-f841cd17cfa5-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-4e4e00e0-8ff1-4181-afca-f841cd17cfa5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-quobyte-4e4e00e0-8ff1-4181-afca-f841cd17cfa5" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-4e4e00e0-8ff1-4181-afca-f841cd17cfa5" acquired by "delete_volume" :: waited 0.040s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc04b0ea-ddb3-47ff-ae3c-254ff3accbe3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:13 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51 Nov 02 10:10:13 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:13 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 Nov 02 10:10:13 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:13 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd" returned: 0 in 0.813s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:13 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd Nov 02 10:10:13 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:13 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5" returned: 0 in 0.516s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:14 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5 Nov 02 10:10:14 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:14 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51" returned: 0 in 0.797s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:14 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51 Nov 02 10:10:14 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:14 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-23b241b0-19cc-4783-a2d7-86ac359d80cd" returned: 0 in 0.538s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Lock "cinder-quobyte-23b241b0-19cc-4783-a2d7-86ac359d80cd" released by "delete_volume" :: held 1.446s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:14 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4e4e00e0-8ff1-4181-afca-f841cd17cfa5" returned: 0 in 0.391s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-4e4e00e0-8ff1-4181-afca-f841cd17cfa5" released by "delete_volume" :: held 0.999s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Created reservations ['8e01cada-6556-44de-8c63-dfcf4b846566', '10d97407-4a35-4d1d-b4aa-8a3d256bd825', '4400f179-c5f3-476f-88eb-4640e065a8c2', 'f72176eb-581c-43af-8924-3e78d51bd1a7'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:14 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-435ac11f-aa75-4116-81fe-41c139daaa51" returned: 0 in 0.437s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Created reservations ['aedc37f1-8dc6-4cc0-81af-e189261dd896', '5ba6b67d-8286-48bd-95b1-0c9fc8a001da', 'eef04531-e9a1-4934-b512-ab22d7d0225f', '1ed1193a-9cb9-4f09-8961-3a2d34f47253'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-quobyte-435ac11f-aa75-4116-81fe-41c139daaa51" released by "delete_volume" :: held 1.338s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:14 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:14 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Created reservations ['be7c3818-38f2-4c9b-bcbe-66b862a675f1', 'bb6fdefa-eff7-4e81-9fb9-2fa17ebd77d7', 'ae4eab9c-372c-47eb-b75e-c956407c0bc9', '0fe3105e-cfaf-4cdf-b2fe-5701ba005bce'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:14 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:14 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:14 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:14 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:15 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.379s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Deleted volume successfully. Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-534dd3e0-5ef9-46d0-98cf-b269a0f849e2 tempest-VolumesListAdminTestJSON-735155498 None] Lock "cinder-23b241b0-19cc-4783-a2d7-86ac359d80cd-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:15 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.277s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Deleted volume successfully. Nov 02 10:10:15 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.527s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Deleted volume successfully. Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8a708191-8340-4c3f-9a75-b577523ac93a tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-435ac11f-aa75-4116-81fe-41c139daaa51-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4ef8edda-b9d4-40cd-bea3-b803d7e9cf3b tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-4e4e00e0-8ff1-4181-afca-f841cd17cfa5-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "cinder-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "cinder-quobyte-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-quobyte-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e67e7-fe96-45b7-8928-8a01ff00c514]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:15 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 Nov 02 10:10:15 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "cinder-quobyte-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51" acquired by "delete_volume" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d565aa75-cab8-4af1-b336-88001e1cf77f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:16 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 Nov 02 10:10:16 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:16 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5" returned: 0 in 0.581s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:16 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5 Nov 02 10:10:16 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:16 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51" returned: 0 in 0.544s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:16 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5" returned: 0 in 0.312s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:16 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51 Nov 02 10:10:16 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-quobyte-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5" released by "delete_volume" :: held 0.952s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Created reservations ['237c8909-7da8-4c6b-951b-5346ea480b51', '6d9aca1c-2d74-45e8-84d5-fde848c3d71b', '7d8c3511-7a1c-4dc1-908d-3e7d02566859', 'fd3ef074-5227-4bfb-b178-b79d2c9e9b4c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:16 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:16 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:17 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51" returned: 0 in 0.733s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-quobyte-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51" released by "delete_volume" :: held 1.345s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Created reservations ['45f0166d-2d29-4e00-a218-35de7df49247', '5de5c9db-e8f0-40ac-81bb-ee37cae26fb3', 'a50b6662-07ac-40e9-906e-66f22e1af97a', '37be1e45-8d32-471b-8266-f2af994171f5'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:17 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.571s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Deleted volume successfully. Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fb4704b8-e8c7-4ad5-9433-969a2d7631e2 tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-914ea4be-bf3f-42f5-ac84-9aff5fdfb1b5-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:17 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:17 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:17 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.419s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Deleted volume successfully. Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "cinder-deb9f81a-8d24-4bea-889b-344f63270f31-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-54826b03-2934-4f86-8c79-2906793bd31d tempest-CreateVolumesFromImageTest-1232120650 None] Lock "cinder-d1068fc3-99b2-4d6d-8e6e-dd63cce6de51-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-deb9f81a-8d24-4bea-889b-344f63270f31-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "cinder-quobyte-deb9f81a-8d24-4bea-889b-344f63270f31" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-quobyte-deb9f81a-8d24-4bea-889b-344f63270f31" acquired by "delete_volume" :: waited 0.034s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:18 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ca509c-bce5-4268-9a7d-b5b4e0b3b256]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:18 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31 Nov 02 10:10:18 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:18 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31" returned: 0 in 0.518s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:18 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31 Nov 02 10:10:18 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:18 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-deb9f81a-8d24-4bea-889b-344f63270f31" returned: 0 in 0.374s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-quobyte-deb9f81a-8d24-4bea-889b-344f63270f31" released by "delete_volume" :: held 0.953s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Created reservations ['662d9e3a-0dd1-4855-a7ee-1b49c4ad068c', 'ff1f818d-c75c-4838-a644-ad7e895bc174', '91b6e213-6cda-4072-9f08-a5b17eba97a2', '0081111d-7104-4392-9bfc-6482100eab5e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:19 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:19 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:19 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.490s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Deleted volume successfully. Nov 02 10:10:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a6609e05-e720-4159-b8f1-0a1591cd64df tempest-VolumesListAdminTestJSON-1549627232 None] Lock "cinder-deb9f81a-8d24-4bea-889b-344f63270f31-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:10:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:20 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:20 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:21 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.444s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:10:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:10:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=118,cinder:UPDATE=150,cinder:INSERT=38,cinder:DELETE=18 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=156,cinder:INSERT=30,cinder:DELETE=8,cinder:SELECT=113 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Flow 'volume_create_manager' (49a9cb06-8503-43fc-99ed-d8a864bcd1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc616712-84d1-49e1-bb47-65e74556a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc616712-84d1-49e1-bb47-65e74556a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2002973117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915d8dee-fb6b-4267-8f9f-7155e303b280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c9585c16a04a1881fa88cdf30b25be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:29Z,use_quota=True,user_id='5b788710841442c3baf40504c742c974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaccc90-7ef9-4475-8aba-d96945ce5163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaccc90-7ef9-4475-8aba-d96945ce5163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa20c05f-2ff0-407e-9782-ec6d05312e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:29 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa20c05f-2ff0-407e-9782-ec6d05312e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '915d8dee-fb6b-4267-8f9f-7155e303b280', 'volume_name': 'volume-915d8dee-fb6b-4267-8f9f-7155e303b280', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cff056-6393-4890-8a2c-d5bdf9fb7890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cff056-6393-4890-8a2c-d5bdf9fb7890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef1efb6-8e7e-4f42-81ad-dc5d3b5e31b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:30 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Volume 915d8dee-fb6b-4267-8f9f-7155e303b280: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-915d8dee-fb6b-4267-8f9f-7155e303b280', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Trying to clone 915d8dee-fb6b-4267-8f9f-7155e303b280 from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:10:30 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e69aa35-0a6d-4bd4-a94d-d49081fcaa0d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:30 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD Nov 02 10:10:30 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:30 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:30 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 is fetched for user 5b788710841442c3baf40504c742c974. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b7f0ff-d5bf-46de-bbd2-fe304325b80d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:31 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD Nov 02 10:10:31 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:31 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2002973117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915d8dee-fb6b-4267-8f9f-7155e303b280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c9585c16a04a1881fa88cdf30b25be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:29Z,use_quota=True,user_id='5b788710841442c3baf40504c742c974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Creating volume 915d8dee-fb6b-4267-8f9f-7155e303b280 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:31 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:31 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 1073741824 Nov 02 10:10:31 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:31 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 1073741824" returned: 0 in 0.573s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:32 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 Nov 02 10:10:32 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:32 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280" returned: 0 in 0.349s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:32 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Attempting download of 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume 915d8dee-fb6b-4267-8f9f-7155e303b280. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:10:32 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58b6a2a-a8c5-4f8d-90c3-2334acf28619]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_xb7l31f5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:32 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_xb7l31f5 Nov 02 10:10:32 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:32 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_xb7l31f5" returned: 0 in 0.452s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_xb7l31f5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:33 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_xb7l31f5 Nov 02 10:10:33 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:33 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_xb7l31f5" returned: 1 in 0.422s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_xb7l31f5' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:10:33 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[01964a08-e85d-457a-91f8-a0b3a306c5d6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:33 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD Nov 02 10:10:33 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:33 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:33 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 was qcow2, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:10:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:33 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 Nov 02 10:10:33 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:36 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280" returned: 0 in 2.565s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:36 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_iec4oqubdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:10:36 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Converted 112.00 MB image at 43.64 MB/s Nov 02 10:10:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:36 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 1G Nov 02 10:10:36 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:36 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 1G" returned: 0 in 0.411s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:36 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Downloaded image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume 915d8dee-fb6b-4267-8f9f-7155e303b280 successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:10:36 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 for user 5b788710841442c3baf40504c742c974 is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:10:36 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Marking volume 915d8dee-fb6b-4267-8f9f-7155e303b280 as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:10:36 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Copying metadata from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 to 915d8dee-fb6b-4267-8f9f-7155e303b280. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:10:36 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Creating volume glance metadata for volume 915d8dee-fb6b-4267-8f9f-7155e303b280 backed by image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:10:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef1efb6-8e7e-4f42-81ad-dc5d3b5e31b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915d8dee-fb6b-4267-8f9f-7155e303b280', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592a8964-adbe-49ad-b4fa-98ba5b9c22e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:37 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Volume volume-915d8dee-fb6b-4267-8f9f-7155e303b280 (915d8dee-fb6b-4267-8f9f-7155e303b280): created successfully Nov 02 10:10:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592a8964-adbe-49ad-b4fa-98ba5b9c22e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Flow 'volume_create_manager' (49a9cb06-8503-43fc-99ed-d8a864bcd1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:37 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-fdaec7c2-f31f-49a0-8b17-321446d7f62c tempest-VolumesImageMetadata-342488643 None] Created volume successfully. Nov 02 10:10:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Acquiring lock "cinder-915d8dee-fb6b-4267-8f9f-7155e303b280-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Lock "cinder-915d8dee-fb6b-4267-8f9f-7155e303b280-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Acquiring lock "cinder-quobyte-915d8dee-fb6b-4267-8f9f-7155e303b280" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Lock "cinder-quobyte-915d8dee-fb6b-4267-8f9f-7155e303b280" acquired by "delete_volume" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[04766681-0ffa-4bd2-9704-b8bf05b3f868]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:39 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 Nov 02 10:10:39 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:39 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280" returned: 0 in 0.381s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:39 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280 Nov 02 10:10:39 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:39 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-915d8dee-fb6b-4267-8f9f-7155e303b280" returned: 0 in 0.274s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Lock "cinder-quobyte-915d8dee-fb6b-4267-8f9f-7155e303b280" released by "delete_volume" :: held 0.719s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Created reservations ['6968e545-c293-4b8f-bb4a-553fafc46c9c', '274520de-3243-4a04-b667-e49e5fa3aa82', '73b54f3e-4f7b-4cf3-a0cb-de082d7f93a8', 'ebeaf482-bc87-4984-9841-a651e3c21d88'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:39 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:39 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:40 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.287s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:40 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:40 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Deleted volume successfully. Nov 02 10:10:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9b9e5c38-3429-47ef-9896-5a2af0eb7559 tempest-VolumesImageMetadata-342488643 None] Lock "cinder-915d8dee-fb6b-4267-8f9f-7155e303b280-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Flow 'volume_create_manager' (da4ed336-6b9e-496d-b3c8-17c0a113e331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01464c0-4707-469f-9541-1ac4024fcaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01464c0-4707-469f-9541-1ac4024fcaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1101701702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362d4568-3c12-466f-9f51-2a09ec7651f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132cd821b1cb4119843ff1c140e1bc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:45Z,use_quota=True,user_id='5bf4ab6badca43e09a8b89f75ec3b038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ed9121-aab7-4baa-a005-81ff65a363e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ed9121-aab7-4baa-a005-81ff65a363e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9e94ca-198f-4f7d-97d4-4a3af8db8903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9e94ca-198f-4f7d-97d4-4a3af8db8903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '362d4568-3c12-466f-9f51-2a09ec7651f4', 'volume_name': 'volume-362d4568-3c12-466f-9f51-2a09ec7651f4', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc60597-0c3d-4b4b-99bd-03b469f93a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc60597-0c3d-4b4b-99bd-03b469f93a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e2f8d5-d6fd-45e9-9f89-fe857a623b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:44 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Volume 362d4568-3c12-466f-9f51-2a09ec7651f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-362d4568-3c12-466f-9f51-2a09ec7651f4', 'volume_size': 1} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1101701702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362d4568-3c12-466f-9f51-2a09ec7651f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132cd821b1cb4119843ff1c140e1bc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:45Z,use_quota=True,user_id='5bf4ab6badca43e09a8b89f75ec3b038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Creating volume 362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:10:44 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:10:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:44 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 1073741824 Nov 02 10:10:44 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:45 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 1073741824" returned: 0 in 0.466s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:45 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 Nov 02 10:10:45 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:45 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4" returned: 0 in 0.277s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:10:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e2f8d5-d6fd-45e9-9f89-fe857a623b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-362d4568-3c12-466f-9f51-2a09ec7651f4', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d74adc2-0caa-4b56-90fb-89cb7dfea97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:10:45 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Volume volume-362d4568-3c12-466f-9f51-2a09ec7651f4 (362d4568-3c12-466f-9f51-2a09ec7651f4): created successfully Nov 02 10:10:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d74adc2-0caa-4b56-90fb-89cb7dfea97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:10:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Flow 'volume_create_manager' (da4ed336-6b9e-496d-b3c8-17c0a113e331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:10:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c5daf992-99d8-40bd-987c-e2efa0f786bc tempest-VolumesDeleteCascade-1775972894 None] Created volume successfully. Nov 02 10:10:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Creating offline snapshot f21812c5-8de8-4491-87f8-aed0d5da10ce of volume 362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:10:46 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f97dd4-d795-459b-a0ab-5a9d60b74a36]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:47 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 Nov 02 10:10:47 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:47 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4" returned: 0 in 0.427s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:47 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce 1G Nov 02 10:10:47 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:47 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce 1G" returned: 0 in 0.564s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362d4568-3c12-466f-9f51-2a09ec7651f4 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:48 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362d4568-3c12-466f-9f51-2a09ec7651f4 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce Nov 02 10:10:48 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:48 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362d4568-3c12-466f-9f51-2a09ec7651f4 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce" returned: 0 in 0.395s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:48 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce is being set with open permissions: ugo+rw Nov 02 10:10:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:48 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce Nov 02 10:10:48 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:48 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce" returned: 0 in 0.337s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:48 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.info Nov 02 10:10:48 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:49 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.info" returned: 0 in 0.379s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:49 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.info is being set with open permissions: ugo+rw Nov 02 10:10:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:49 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.info Nov 02 10:10:49 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:49 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.info" returned: 0 in 0.414s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-272887f5-6449-4080-8c5e-3d054daeb14a tempest-VolumesDeleteCascade-1775972894 None] Create snapshot completed successfully Nov 02 10:10:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Creating offline snapshot 0d132960-3568-4162-81dd-51dd6812faed of volume 362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:10:50 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4623150-27c5-4fb3-a962-4a0d6aa45539]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:50 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce Nov 02 10:10:50 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:51 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce" returned: 0 in 0.500s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-362d4568-3c12-466f-9f51-2a09ec7651f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:10:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:51 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed 1G Nov 02 10:10:51 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:52 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed 1G" returned: 0 in 1.001s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:52 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed Nov 02 10:10:52 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-2c8fbd96-f6de-4e61-9686-09d5997b767b req-22ed7a84-88c9-4a52-8e64-57da9753ad70 tempest-TestMinimumBasicScenario-477394516 None] Terminate volume connection completed successfully. Nov 02 10:10:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-2c8fbd96-f6de-4e61-9686-09d5997b767b req-22ed7a84-88c9-4a52-8e64-57da9753ad70 tempest-TestMinimumBasicScenario-477394516 None] Deleting attachment b2c01c37-61e7-4684-97e6-75948362482d. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:10:52 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed" returned: 0 in 0.485s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:52 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed is being set with open permissions: ugo+rw Nov 02 10:10:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:52 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed Nov 02 10:10:52 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:52 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed" returned: 0 in 0.342s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-fb40114a-aa49-4063-87dd-24670146b0d8 tempest-VolumesDeleteCascade-1775972894 None] Create snapshot completed successfully Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Acquiring lock "cinder-38c9f015-46fe-4fb7-8a59-c26d5fee8279-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Lock "cinder-38c9f015-46fe-4fb7-8a59-c26d5fee8279-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Acquiring lock "cinder-quobyte-38c9f015-46fe-4fb7-8a59-c26d5fee8279" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Lock "cinder-quobyte-38c9f015-46fe-4fb7-8a59-c26d5fee8279" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8fbd74-f8cf-4f24-a04d-a3c186ea0125]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:53 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 Nov 02 10:10:53 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:53 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279" returned: 0 in 0.436s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:53 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279 Nov 02 10:10:53 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-362d4568-3c12-466f-9f51-2a09ec7651f4-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-362d4568-3c12-466f-9f51-2a09ec7651f4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Performing cascade delete. {{(pid=86840) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-0d132960-3568-4162-81dd-51dd6812faed-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-0d132960-3568-4162-81dd-51dd6812faed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-362d4568-3c12-466f-9f51-2a09ec7651f4" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-362d4568-3c12-466f-9f51-2a09ec7651f4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-0d132960-3568-4162-81dd-51dd6812faed" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-0d132960-3568-4162-81dd-51dd6812faed" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Deleting offline snapshot 0d132960-3568-4162-81dd-51dd6812faed of volume 362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] snapshot_file for this snap is: volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:10:53 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-38c9f015-46fe-4fb7-8a59-c26d5fee8279" returned: 0 in 0.319s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[47217a56-bd63-46cc-9347-f97ee8b224ea]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Lock "cinder-quobyte-38c9f015-46fe-4fb7-8a59-c26d5fee8279" released by "delete_volume" :: held 0.815s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Created reservations ['296d8c78-48ff-4fc2-ae0f-3535f7c1e32a', '7bd6e6e9-dd2f-412b-8c70-8d8df7a29e1e', 'cccceed6-cb18-4d47-a916-2745abcad60d', '90051d9a-94f1-4355-819d-2b8b1f337c7b'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:54 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed Nov 02 10:10:54 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:54 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:54 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:54 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:54 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.344s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed" returned: 0 in 0.538s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-362d4568-3c12-466f-9f51-2a09ec7651f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:10:54 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Deleted volume successfully. Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc1d07-c049-42ed-9f45-13ffc62f04fd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-979d8305-f0d3-4385-afd5-cab2af4aa9fd tempest-TestMinimumBasicScenario-477394516 None] Lock "cinder-38c9f015-46fe-4fb7-8a59-c26d5fee8279-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:54 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce Nov 02 10:10:54 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:55 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce" returned: 0 in 0.610s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-362d4568-3c12-466f-9f51-2a09ec7651f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:10:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:55 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed Nov 02 10:10:55 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:55 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed" returned: 0 in 0.499s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:55 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed Nov 02 10:10:55 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:56 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.0d132960-3568-4162-81dd-51dd6812faed" returned: 0 in 0.358s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-0d132960-3568-4162-81dd-51dd6812faed" released by "_delete_snapshot" :: held 2.167s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-362d4568-3c12-466f-9f51-2a09ec7651f4" released by "delete_snapshot" :: held 2.204s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Created reservations ['428a3e1d-be59-4395-8f5e-5aeedc21abdc', 'f285497f-90bb-4b87-8a87-e2918933dfb1', '66f928a8-7585-4cc5-9f6b-92654e1bf197', '62adf212-175a-44fa-84ad-3f1c1336bb08'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Delete snapshot completed successfully. Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-0d132960-3568-4162-81dd-51dd6812faed-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-f21812c5-8de8-4491-87f8-aed0d5da10ce-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-f21812c5-8de8-4491-87f8-aed0d5da10ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-362d4568-3c12-466f-9f51-2a09ec7651f4" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-362d4568-3c12-466f-9f51-2a09ec7651f4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-f21812c5-8de8-4491-87f8-aed0d5da10ce" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-f21812c5-8de8-4491-87f8-aed0d5da10ce" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Deleting offline snapshot f21812c5-8de8-4491-87f8-aed0d5da10ce of volume 362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] snapshot_file for this snap is: volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[436c7768-f76e-4f2a-89a7-1a476986d4bf]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:56 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce Nov 02 10:10:56 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:56 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce" returned: 0 in 0.458s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-362d4568-3c12-466f-9f51-2a09ec7651f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c37959e-2b69-43dd-bffe-f7825d03d65d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:57 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 Nov 02 10:10:57 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:57 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4" returned: 0 in 0.521s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:57 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce Nov 02 10:10:57 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:57 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce" returned: 0 in 0.477s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:57 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce Nov 02 10:10:57 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:58 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4.f21812c5-8de8-4491-87f8-aed0d5da10ce" returned: 0 in 0.306s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-f21812c5-8de8-4491-87f8-aed0d5da10ce" released by "_delete_snapshot" :: held 1.927s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-362d4568-3c12-466f-9f51-2a09ec7651f4" released by "delete_snapshot" :: held 1.965s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Created reservations ['e12ad24a-e632-4d37-9cad-d32205b23d4d', '9fad75b5-ee14-46df-b428-096a1b011c2c', '56258b32-0c63-48f3-9c7f-241e27178af8', '49445b0e-9088-412d-80b7-7fd6cac20780'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:58 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Delete snapshot completed successfully. Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-f21812c5-8de8-4491-87f8-aed0d5da10ce-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Snapshots deleted, issuing volume delete {{(pid=86840) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-362d4568-3c12-466f-9f51-2a09ec7651f4" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-362d4568-3c12-466f-9f51-2a09ec7651f4" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1c2c39-deab-4c78-af53-fbf271ecbcf9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:10:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:58 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 Nov 02 10:10:58 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:59 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4" returned: 0 in 0.463s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:59 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4 Nov 02 10:10:59 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:59 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-362d4568-3c12-466f-9f51-2a09ec7651f4" returned: 0 in 0.274s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-362d4568-3c12-466f-9f51-2a09ec7651f4" released by "delete_volume" :: held 0.834s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Created reservations ['28dc4c24-ee35-4d63-b659-2b682ce62473', '383e1dac-978a-4a90-a1c3-9bd0335117d3', '5726f188-ec7e-46ab-aba2-f019e01ad112', '3e4ec9d5-38ce-47d0-8f13-8f67ca144798'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:10:59 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:10:59 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:10:59 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.303s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:10:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Deleted volume successfully. Nov 02 10:10:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ae4c29c6-3b9a-4d8a-91f4-5fd48831d3b8 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-362d4568-3c12-466f-9f51-2a09ec7651f4-delete_volume" released by "delete_volume" :: held 6.102s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Flow 'volume_create_manager' (04c1e28b-3a1d-4dc2-b882-ac4eacda3224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc36720-0db6-4c76-b811-1507e9010218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc36720-0db6-4c76-b811-1507e9010218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2063961561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adfd794-b54b-4d69-a39c-30119748c248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132cd821b1cb4119843ff1c140e1bc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:01Z,use_quota=True,user_id='5bf4ab6badca43e09a8b89f75ec3b038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71222e4a-db2c-4068-ac84-4879026c4149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71222e4a-db2c-4068-ac84-4879026c4149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3015f800-972f-474d-9c72-3a0f815b2e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3015f800-972f-474d-9c72-3a0f815b2e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1adfd794-b54b-4d69-a39c-30119748c248', 'volume_name': 'volume-1adfd794-b54b-4d69-a39c-30119748c248', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bca81c-c276-4161-bbbd-2bc02d05f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bca81c-c276-4161-bbbd-2bc02d05f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53b1e5e-6538-41fa-aff1-cdde821b341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:01 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Volume 1adfd794-b54b-4d69-a39c-30119748c248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1adfd794-b54b-4d69-a39c-30119748c248', 'volume_size': 1} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2063961561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adfd794-b54b-4d69-a39c-30119748c248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132cd821b1cb4119843ff1c140e1bc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:01Z,use_quota=True,user_id='5bf4ab6badca43e09a8b89f75ec3b038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Creating volume 1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:01 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:11:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:01 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 1073741824 Nov 02 10:11:01 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:02 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 1073741824" returned: 0 in 0.682s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:02 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 Nov 02 10:11:02 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:02 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248" returned: 0 in 0.370s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53b1e5e-6538-41fa-aff1-cdde821b341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adfd794-b54b-4d69-a39c-30119748c248', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5e39cc-4d88-47de-95e8-d46d5eee0fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Volume volume-1adfd794-b54b-4d69-a39c-30119748c248 (1adfd794-b54b-4d69-a39c-30119748c248): created successfully Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5e39cc-4d88-47de-95e8-d46d5eee0fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Flow 'volume_create_manager' (04c1e28b-3a1d-4dc2-b882-ac4eacda3224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-50633525-b349-4b6a-8eee-4079be2716d8 tempest-VolumesDeleteCascade-1775972894 None] Created volume successfully. Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Flow 'volume_create_manager' (66fca0de-86d6-4714-85a1-f4594d03c4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eab9292-7ea2-45c0-a4b1-2daf962b8fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eab9292-7ea2-45c0-a4b1-2daf962b8fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-253846311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b7de6a-3365-461a-8586-8063401c7d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e3833f756349b79a972ffc4e16efaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:03Z,use_quota=True,user_id='5590d6e48e0c44a6b694667e0a7c7536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dd3cea-4c9a-4eb0-a8c2-25ebdeace4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dd3cea-4c9a-4eb0-a8c2-25ebdeace4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88419f08-d0b5-47f0-a887-c14d896b4e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88419f08-d0b5-47f0-a887-c14d896b4e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b7de6a-3365-461a-8586-8063401c7d59', 'volume_name': 'volume-57b7de6a-3365-461a-8586-8063401c7d59', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b73c0a3-efda-4304-b9cc-2e2a781d3ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b73c0a3-efda-4304-b9cc-2e2a781d3ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73838b0-e040-4960-92e9-799be25373e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Volume 57b7de6a-3365-461a-8586-8063401c7d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b7de6a-3365-461a-8586-8063401c7d59', 'volume_size': 1} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-253846311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b7de6a-3365-461a-8586-8063401c7d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e3833f756349b79a972ffc4e16efaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:03Z,use_quota=True,user_id='5590d6e48e0c44a6b694667e0a7c7536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Creating volume 57b7de6a-3365-461a-8586-8063401c7d59 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:02 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:11:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:02 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59 1073741824 Nov 02 10:11:02 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:03 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59 1073741824" returned: 0 in 0.609s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:03 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59 Nov 02 10:11:03 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:03 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59" returned: 0 in 0.371s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.049s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73838b0-e040-4960-92e9-799be25373e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b7de6a-3365-461a-8586-8063401c7d59', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51194d55-2643-4352-9f36-99f0f5e66059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Creating offline snapshot ebf79e24-f151-4b5d-8bcd-f49dec917a03 of volume 1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:11:03 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Volume volume-57b7de6a-3365-461a-8586-8063401c7d59 (57b7de6a-3365-461a-8586-8063401c7d59): created successfully Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51194d55-2643-4352-9f36-99f0f5e66059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Flow 'volume_create_manager' (66fca0de-86d6-4714-85a1-f4594d03c4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7d20dc-0491-4d72-a69c-0e715ed2f706]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7f21e93d-0cbe-4be6-919c-bdd14a32a675 tempest-AttachVolumeNegativeTest-1835097764 None] Created volume successfully. Nov 02 10:11:04 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 Nov 02 10:11:04 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:04 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248" returned: 0 in 0.438s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:04 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 1G Nov 02 10:11:04 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:04 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 1G" returned: 0 in 0.565s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1adfd794-b54b-4d69-a39c-30119748c248 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:04 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1adfd794-b54b-4d69-a39c-30119748c248 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 Nov 02 10:11:04 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:05 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1adfd794-b54b-4d69-a39c-30119748c248 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03" returned: 0 in 0.423s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:05 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 is being set with open permissions: ugo+rw Nov 02 10:11:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:05 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 Nov 02 10:11:05 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:05 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03" returned: 0 in 0.402s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:05 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.info Nov 02 10:11:05 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-a6d0e232-f738-427f-a167-1bc51e372c43 req-2b469d31-e570-4867-bf4c-772cd54564b0 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:06 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.info" returned: 0 in 0.323s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:06 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.info is being set with open permissions: ugo+rw Nov 02 10:11:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:06 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.info Nov 02 10:11:06 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:06 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.info" returned: 0 in 0.288s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-a6d0e232-f738-427f-a167-1bc51e372c43 req-2b469d31-e570-4867-bf4c-772cd54564b0 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.415s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-a6d0e232-f738-427f-a167-1bc51e372c43 req-2b469d31-e570-4867-bf4c-772cd54564b0 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6394db1f-555c-4f64-9f64-000093f15eb8 tempest-VolumesDeleteCascade-1775972894 None] Create snapshot completed successfully Nov 02 10:11:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-a6d0e232-f738-427f-a167-1bc51e372c43 req-2b469d31-e570-4867-bf4c-772cd54564b0 tempest-AttachVolumeNegativeTest-1835097764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-57b7de6a-3365-461a-8586-8063401c7d59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1a0a835-528c-4582-818f-19d0925ad175', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:11:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-a6d0e232-f738-427f-a167-1bc51e372c43 req-2b469d31-e570-4867-bf4c-772cd54564b0 tempest-AttachVolumeNegativeTest-1835097764 None] attachment_update completed successfully. Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Flow 'volume_create_manager' (6b797304-7e18-40a5-b360-ac59ae55cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e39079-b4b4-4ab7-b4ba-e98293982ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e39079-b4b4-4ab7-b4ba-e98293982ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1098681113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7d401a-d647-47c5-8ea7-9fbab74d6db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132cd821b1cb4119843ff1c140e1bc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebf79e24-f151-4b5d-8bcd-f49dec917a03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:08Z,use_quota=True,user_id='5bf4ab6badca43e09a8b89f75ec3b038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9569ffc0-0f8a-467c-a9b5-7e9986b6d45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9569ffc0-0f8a-467c-a9b5-7e9986b6d45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ac1658-aa15-4dad-b2cf-a3b5099e2b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ac1658-aa15-4dad-b2cf-a3b5099e2b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f7d401a-d647-47c5-8ea7-9fbab74d6db2', 'volume_name': 'volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2', 'volume_size': 1, 'snapshot_id': 'ebf79e24-f151-4b5d-8bcd-f49dec917a03'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854b53a1-7f2d-4d5b-9e0e-8efb03436ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854b53a1-7f2d-4d5b-9e0e-8efb03436ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c319e9cb-44e6-401e-80c4-5b0e7a722708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Volume 6f7d401a-d647-47c5-8ea7-9fbab74d6db2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2', 'volume_size': 1, 'snapshot_id': 'ebf79e24-f151-4b5d-8bcd-f49dec917a03'} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-ebf79e24-f151-4b5d-8bcd-f49dec917a03-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" by "_create_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-ebf79e24-f151-4b5d-8bcd-f49dec917a03-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Creating volume 6f7d401a-d647-47c5-8ea7-9fbab74d6db2 from snapshot ebf79e24-f151-4b5d-8bcd-f49dec917a03 {{(pid=86840) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] snapshot: ebf79e24-f151-4b5d-8bcd-f49dec917a03, volume: 6f7d401a-d647-47c5-8ea7-9fbab74d6db2, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b474b4-3bca-4bb0-8304-a9c76bab0a83]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:08 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 Nov 02 10:11:08 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:08 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03" returned: 0 in 0.588s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1adfd794-b54b-4d69-a39c-30119748c248(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b58a014-e970-4910-827c-385fe727ab14]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:08 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 Nov 02 10:11:08 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:09 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248" returned: 0 in 0.617s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:11:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:11:09 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:11:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:09 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 Nov 02 10:11:09 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:17 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=56,cinder:INSERT=27,cinder:UPDATE=50,cinder:DELETE=6 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:11:18 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=64,cinder:INSERT=12,cinder:UPDATE=58,cinder:DELETE=4 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:11:19 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" returned: 0 in 9.863s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248, size 1024.00 MB, duration 9.86 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:11:19 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Converted 1024.00 MB image at 103.80 MB/s Nov 02 10:11:19 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 is being set with open permissions: ugo+rw Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:19 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 Nov 02 10:11:19 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:19 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" returned: 0 in 0.280s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" released by "_copy_volume_from_snapshot" :: held 11.486s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-ebf79e24-f151-4b5d-8bcd-f49dec917a03-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" released by "_create_volume_from_snapshot" :: held 11.602s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.621s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c319e9cb-44e6-401e-80c4-5b0e7a722708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2', 'volume_size': 1, 'snapshot_id': 'ebf79e24-f151-4b5d-8bcd-f49dec917a03'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcb8581-4476-42b2-a825-ef9cdea6a50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:19 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Volume volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 (6f7d401a-d647-47c5-8ea7-9fbab74d6db2): created successfully Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcb8581-4476-42b2-a825-ef9cdea6a50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Flow 'volume_create_manager' (6b797304-7e18-40a5-b360-ac59ae55cd95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-43560791-17af-4c2a-9b8b-0d8b98fca028 tempest-VolumesDeleteCascade-1775972894 None] Created volume successfully. Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-1adfd794-b54b-4d69-a39c-30119748c248-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-1adfd794-b54b-4d69-a39c-30119748c248-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Performing cascade delete. {{(pid=86840) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-ebf79e24-f151-4b5d-8bcd-f49dec917a03-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-ebf79e24-f151-4b5d-8bcd-f49dec917a03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-1adfd794-b54b-4d69-a39c-30119748c248" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-1adfd794-b54b-4d69-a39c-30119748c248" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-ebf79e24-f151-4b5d-8bcd-f49dec917a03" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-ebf79e24-f151-4b5d-8bcd-f49dec917a03" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Deleting offline snapshot ebf79e24-f151-4b5d-8bcd-f49dec917a03 of volume 1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] snapshot_file for this snap is: volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0531833a-234b-4687-a2d9-a7957bd9944e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:20 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 Nov 02 10:11:20 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:20 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:11:20 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:21 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03" returned: 0 in 0.612s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1adfd794-b54b-4d69-a39c-30119748c248(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1776fc40-482b-4262-911e-042630df2b9b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:21 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 Nov 02 10:11:21 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:21 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.490s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:11:21 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248" returned: 0 in 0.643s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:21 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 Nov 02 10:11:21 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:22 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03" returned: 0 in 0.770s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:22 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03 Nov 02 10:11:22 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:22 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248.ebf79e24-f151-4b5d-8bcd-f49dec917a03" returned: 0 in 0.384s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-ebf79e24-f151-4b5d-8bcd-f49dec917a03" released by "_delete_snapshot" :: held 2.564s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-1adfd794-b54b-4d69-a39c-30119748c248" released by "delete_snapshot" :: held 2.608s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:23 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Created reservations ['d5956823-5f1f-43c6-99ba-24f591f390c3', 'b89ee363-9c11-42fa-9966-e3e948c4362e', '979b915e-7085-46c6-8931-773c7ef52c7f', '80b63819-7118-446f-a216-cc03bbf2a67a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:23 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Delete snapshot completed successfully. Nov 02 10:11:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-ebf79e24-f151-4b5d-8bcd-f49dec917a03-delete_snapshot" released by "delete_snapshot" :: held 2.922s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Snapshots deleted, issuing volume delete {{(pid=86840) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:11:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-1adfd794-b54b-4d69-a39c-30119748c248" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-1adfd794-b54b-4d69-a39c-30119748c248" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e40df8-d048-41d2-964a-8a1638e14880]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:23 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 Nov 02 10:11:23 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:24 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248" returned: 0 in 0.663s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:24 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248 Nov 02 10:11:24 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:24 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1adfd794-b54b-4d69-a39c-30119748c248" returned: 0 in 0.333s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-1adfd794-b54b-4d69-a39c-30119748c248" released by "delete_volume" :: held 1.106s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Created reservations ['a95e1456-15a6-4f0f-8870-b046e1838306', 'f408611f-65ba-4913-924e-1618e91de49a', 'a932e3f5-7009-481e-ac22-d0685ea93e6d', 'a8f5bf79-3161-4414-ab26-d0812a52704d'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:24 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:11:24 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-6f7d401a-d647-47c5-8ea7-9fbab74d6db2-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-6f7d401a-d647-47c5-8ea7-9fbab74d6db2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "cinder-quobyte-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:25 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" acquired by "delete_volume" :: waited 0.042s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.654s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:25 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Deleted volume successfully. Nov 02 10:11:25 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b03b2-fb53-40b3-bb4b-0e7b3c7afe79]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2aea7d26-f469-4091-93b8-9d95cd0f40d5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-1adfd794-b54b-4d69-a39c-30119748c248-delete_volume" released by "delete_volume" :: held 5.073s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:25 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 Nov 02 10:11:25 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:25 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" returned: 0 in 0.726s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:26 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2 Nov 02 10:11:26 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:26 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" returned: 0 in 0.493s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-quobyte-6f7d401a-d647-47c5-8ea7-9fbab74d6db2" released by "delete_volume" :: held 1.331s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Created reservations ['39ce27e2-e854-44b6-a355-13732937f124', '43643061-b1e3-4723-a89b-6c4a11cff014', '60183452-c15f-47c3-8d12-da6e7b277486', '992570ff-0a19-4ef9-b59f-7547c9e2d465'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:26 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:11:26 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:27 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.397s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:27 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:27 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Deleted volume successfully. Nov 02 10:11:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0f54365b-3993-4962-a70b-5360f8a6c0e5 tempest-VolumesDeleteCascade-1775972894 None] Lock "cinder-6f7d401a-d647-47c5-8ea7-9fbab74d6db2-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:36 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Flow 'volume_create_manager' (61015f7a-c469-4e7a-acd1-e52179cc3073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1caabc-70dc-4219-ae6c-ac53e7e515d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1caabc-70dc-4219-ae6c-ac53e7e515d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-725876611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54939a7-eb17-438e-a403-df0757eb3ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef52bfcbebee4ac9951e09b41c1dcc55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:37Z,use_quota=True,user_id='df691335344e46c086387a65f09a5407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71691784-4e10-4b31-8ac2-415576b84d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71691784-4e10-4b31-8ac2-415576b84d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2334a5-afb9-4010-b3f6-2c21e044f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2334a5-afb9-4010-b3f6-2c21e044f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54939a7-eb17-438e-a403-df0757eb3ab3', 'volume_name': 'volume-a54939a7-eb17-438e-a403-df0757eb3ab3', 'volume_size': 2}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41cf082-d54d-442b-88c8-dc5b98f2da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41cf082-d54d-442b-88c8-dc5b98f2da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629e38a6-71c6-4f24-a1c9-4fc988c94ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:37 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Volume a54939a7-eb17-438e-a403-df0757eb3ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54939a7-eb17-438e-a403-df0757eb3ab3', 'volume_size': 2} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-725876611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54939a7-eb17-438e-a403-df0757eb3ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef52bfcbebee4ac9951e09b41c1dcc55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:37Z,use_quota=True,user_id='df691335344e46c086387a65f09a5407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Creating volume a54939a7-eb17-438e-a403-df0757eb3ab3 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:11:37 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:11:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3 2147483648 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:37 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3 2147483648 Nov 02 10:11:37 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:38 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3 2147483648" returned: 0 in 0.647s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:38 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3 Nov 02 10:11:38 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:38 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3" returned: 0 in 0.304s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:11:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629e38a6-71c6-4f24-a1c9-4fc988c94ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54939a7-eb17-438e-a403-df0757eb3ab3', 'volume_size': 2}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26a512c-5904-4ced-9336-e00eaf30f55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:11:38 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Volume volume-a54939a7-eb17-438e-a403-df0757eb3ab3 (a54939a7-eb17-438e-a403-df0757eb3ab3): created successfully Nov 02 10:11:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26a512c-5904-4ced-9336-e00eaf30f55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:11:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Flow 'volume_create_manager' (61015f7a-c469-4e7a-acd1-e52179cc3073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:11:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b2de34ec-4fdb-4b1f-a25b-517b96d133ae tempest-VolumesCloneNegativeTest-1802080394 None] Created volume successfully. Nov 02 10:11:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Acquiring lock "cinder-a54939a7-eb17-438e-a403-df0757eb3ab3-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Lock "cinder-a54939a7-eb17-438e-a403-df0757eb3ab3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Acquiring lock "cinder-quobyte-a54939a7-eb17-438e-a403-df0757eb3ab3" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:11:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Lock "cinder-quobyte-a54939a7-eb17-438e-a403-df0757eb3ab3" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:11:39 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c83e509-6416-41d5-b087-ded7de8fe1e3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:11:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:40 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3 Nov 02 10:11:40 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:40 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3" returned: 0 in 0.451s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:40 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3 Nov 02 10:11:40 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:40 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a54939a7-eb17-438e-a403-df0757eb3ab3" returned: 0 in 0.288s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Lock "cinder-quobyte-a54939a7-eb17-438e-a403-df0757eb3ab3" released by "delete_volume" :: held 0.793s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Created reservations ['7d7495c0-4b9f-4d7f-a936-31682af88ea7', '4d188124-e555-4690-a935-bc8f6181fca8', '5c4973bf-555e-4c9b-9fa5-a4950861ab64', '86475f8a-f1d9-40a2-b1fd-cbfec39182a2'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:11:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:11:40 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:11:40 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:11:41 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Nov 02 10:11:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.305s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:11:41 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:11:41 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Deleted volume successfully. Nov 02 10:11:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8dbe1e17-18ea-49f1-b8a6-37fdb54ae53d tempest-VolumesCloneNegativeTest-1802080394 None] Lock "cinder-a54939a7-eb17-438e-a403-df0757eb3ab3-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:11:51 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=38,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:11:54 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:11:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-b9b5a062-420e-4663-9bc9-8eda910c8fa1 req-0df3e77b-9f26-4f14-9fcb-faca3e28c9b1 tempest-AttachVolumeNegativeTest-1835097764 None] Terminate volume connection completed successfully. Nov 02 10:11:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-b9b5a062-420e-4663-9bc9-8eda910c8fa1 req-0df3e77b-9f26-4f14-9fcb-faca3e28c9b1 tempest-AttachVolumeNegativeTest-1835097764 None] Deleting attachment d1a0a835-528c-4582-818f-19d0925ad175. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:12:06 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:12:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:12:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:20 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:12:20 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:21 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.390s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:12:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:12:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Flow 'volume_create_manager' (d47c9ad1-6da7-486c-9e6d-a9b5b1740b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe8d182-9fb2-47ce-be37-7d9bf496612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe8d182-9fb2-47ce-be37-7d9bf496612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-244565265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c5ea2034fa435bbdc0c8217b045d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:23Z,use_quota=True,user_id='eafd5164a5fa43d58c8bfca7f8fcd329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c1c158-df6c-44da-a4a5-65c20c3acd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c1c158-df6c-44da-a4a5-65c20c3acd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6f2c20-9222-4ecd-a60b-d648dfba410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6f2c20-9222-4ecd-a60b-d648dfba410c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6', 'volume_name': 'volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590dc1bf-febb-4cbd-a592-875c09f21793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590dc1bf-febb-4cbd-a592-875c09f21793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67051895-583d-43c6-aabe-36192a1fe704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:23 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Volume 7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:12:23 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Trying to clone 7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:12:24 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc9889c-0e35-4a6d-93ec-8154e46c736a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:24 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD Nov 02 10:12:24 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:24 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 is fetched for user eafd5164a5fa43d58c8bfca7f8fcd329. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb49e39a-3424-46a2-8979-a74872e5b5d6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:24 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD Nov 02 10:12:24 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:24 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-244565265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c5ea2034fa435bbdc0c8217b045d72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:23Z,use_quota=True,user_id='eafd5164a5fa43d58c8bfca7f8fcd329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Creating volume 7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:25 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:25 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 1073741824 Nov 02 10:12:25 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:25 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 1073741824" returned: 0 in 0.487s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:25 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 Nov 02 10:12:25 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:25 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6" returned: 0 in 0.299s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Attempting download of 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume 7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c925b9a8-e4dd-40c9-bbda-8ad356dca87b]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_weh9u_zk {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:26 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_weh9u_zk Nov 02 10:12:26 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:26 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_weh9u_zk" returned: 0 in 0.373s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_weh9u_zk {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:26 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_weh9u_zk Nov 02 10:12:26 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:26 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_weh9u_zk" returned: 1 in 0.352s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_weh9u_zk' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:12:26 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b464ec0-29aa-4348-b78c-c1351a85bd3e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:26 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD Nov 02 10:12:26 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:27 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:27 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 was qcow2, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:12:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:27 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 Nov 02 10:12:27 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:28 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Flow 'volume_create_manager' (3879b7fa-c3f5-4180-962b-0f39915cf0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5fe757-0a1c-4bc9-aa9f-f243e70c1d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5fe757-0a1c-4bc9-aa9f-f243e70c1d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-999482623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8ff827-85d3-4d42-be62-db9c5a0c1647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ec394f4ebb4240981ca119d1e6f7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:29Z,use_quota=True,user_id='6346a85ac9a54793ad4cbdc2410bd377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e652c3-5eb1-42bb-8dd2-6a7b63faee9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e652c3-5eb1-42bb-8dd2-6a7b63faee9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78787a70-2ca5-4536-b5f2-80a4247756bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78787a70-2ca5-4536-b5f2-80a4247756bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8ff827-85d3-4d42-be62-db9c5a0c1647', 'volume_name': 'volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824f71ec-0438-4b12-9d51-eded00070253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824f71ec-0438-4b12-9d51-eded00070253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ea178f-4f71-41fb-be70-9247e0d073ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:29 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Volume fc8ff827-85d3-4d42-be62-db9c5a0c1647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647', 'volume_size': 1} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-999482623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8ff827-85d3-4d42-be62-db9c5a0c1647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ec394f4ebb4240981ca119d1e6f7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:29Z,use_quota=True,user_id='6346a85ac9a54793ad4cbdc2410bd377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Creating volume fc8ff827-85d3-4d42-be62-db9c5a0c1647 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:29 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:29 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 1073741824 Nov 02 10:12:29 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:29 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6" returned: 0 in 2.259s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fbf9bca-7451-4b31-85e8-471b19e5d1f1_61pnzq90devstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:12:29 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Converted 112.00 MB image at 49.56 MB/s Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:29 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 1G Nov 02 10:12:29 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:29 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 1073741824" returned: 0 in 0.528s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:29 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:29 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 Nov 02 10:12:29 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 1G" returned: 0 in 0.407s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Downloaded image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}])) to volume 7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Temporary image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 for user eafd5164a5fa43d58c8bfca7f8fcd329 is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Marking volume 7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Copying metadata from image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 to 7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Creating volume glance metadata for volume 7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 backed by image 0fbf9bca-7451-4b31-85e8-471b19e5d1f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67051895-583d-43c6-aabe-36192a1fe704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6', 'volume_size': 1, 'image_id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b5364b1179042af8252e2063aa0fe9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0fbf9bca-7451-4b31-85e8-471b19e5d1f1', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fbf9bca-7451-4b31-85e8-471b19e5d1f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98aa737-8424-43cf-b5ad-332ea044f7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:29 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Volume volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 (7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6): created successfully Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98aa737-8424-43cf-b5ad-332ea044f7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Flow 'volume_create_manager' (d47c9ad1-6da7-486c-9e6d-a9b5b1740b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:29 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5b5dc47b-cb18-415a-8895-594ae0b13b23 tempest-TestShelveInstance-923075576 None] Created volume successfully. Nov 02 10:12:30 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647" returned: 0 in 0.363s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ea178f-4f71-41fb-be70-9247e0d073ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06bfeda-5964-4996-83c1-b6714decbd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:30 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Volume volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 (fc8ff827-85d3-4d42-be62-db9c5a0c1647): created successfully Nov 02 10:12:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06bfeda-5964-4996-83c1-b6714decbd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Flow 'volume_create_manager' (3879b7fa-c3f5-4180-962b-0f39915cf0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:30 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3dfe2041-d4ff-4dde-988e-7813c5b910f8 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Created volume successfully. Nov 02 10:12:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-5b163c8f-31fe-4557-bf89-bd140570941b req-96bd910c-2abf-4404-b74b-0b6b146cdce6 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-5b163c8f-31fe-4557-bf89-bd140570941b req-96bd910c-2abf-4404-b74b-0b6b146cdce6 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-5b163c8f-31fe-4557-bf89-bd140570941b req-96bd910c-2abf-4404-b74b-0b6b146cdce6 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-5b163c8f-31fe-4557-bf89-bd140570941b req-96bd910c-2abf-4404-b74b-0b6b146cdce6 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f4b6b41-5d46-45db-8028-f8edf6bf8d94', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:12:32 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-5b163c8f-31fe-4557-bf89-bd140570941b req-96bd910c-2abf-4404-b74b-0b6b146cdce6 tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] attachment_update completed successfully. Nov 02 10:12:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-c3c432cc-5121-4053-87af-5ec675652cea req-b4b1eeb8-856c-4f32-9c5d-d513fa722b7f tempest-TestShelveInstance-923075576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-c3c432cc-5121-4053-87af-5ec675652cea req-b4b1eeb8-856c-4f32-9c5d-d513fa722b7f tempest-TestShelveInstance-923075576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-c3c432cc-5121-4053-87af-5ec675652cea req-b4b1eeb8-856c-4f32-9c5d-d513fa722b7f tempest-TestShelveInstance-923075576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-c3c432cc-5121-4053-87af-5ec675652cea req-b4b1eeb8-856c-4f32-9c5d-d513fa722b7f tempest-TestShelveInstance-923075576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90987f90-53d7-4398-9f79-bbbcf97dd6f3', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:12:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-c3c432cc-5121-4053-87af-5ec675652cea req-b4b1eeb8-856c-4f32-9c5d-d513fa722b7f tempest-TestShelveInstance-923075576 None] attachment_update completed successfully. Nov 02 10:12:35 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-5ab3eefb-e6eb-48f5-8182-3d363691ce03 req-022f7b6a-7180-4598-bdfa-a6f7b70a11ef tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Terminate volume connection completed successfully. Nov 02 10:12:35 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-5ab3eefb-e6eb-48f5-8182-3d363691ce03 req-022f7b6a-7180-4598-bdfa-a6f7b70a11ef tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Deleting attachment 4f4b6b41-5d46-45db-8028-f8edf6bf8d94. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:12:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Acquiring lock "cinder-fc8ff827-85d3-4d42-be62-db9c5a0c1647-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "cinder-fc8ff827-85d3-4d42-be62-db9c5a0c1647-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Acquiring lock "cinder-quobyte-fc8ff827-85d3-4d42-be62-db9c5a0c1647" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:12:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "cinder-quobyte-fc8ff827-85d3-4d42-be62-db9c5a0c1647" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:12:36 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[628e2212-bd2a-40cd-b969-d84194f7033f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:12:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:36 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 Nov 02 10:12:36 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:37 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647" returned: 0 in 0.771s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:37 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647 Nov 02 10:12:37 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:37 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fc8ff827-85d3-4d42-be62-db9c5a0c1647" returned: 0 in 0.423s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "cinder-quobyte-fc8ff827-85d3-4d42-be62-db9c5a0c1647" released by "delete_volume" :: held 1.269s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Created reservations ['95e02bad-4369-407d-ae5e-f3368d8d8bc3', 'c0c94b55-83e8-41e0-8643-6c5ed9ea55cc', 'f9be7a68-a3f4-442d-8e76-98146a46bb02', '21c2c207-fb1b-462f-8e19-9130be51c536'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:37 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:12:37 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:38 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.298s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:38 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:12:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Deleted volume successfully. Nov 02 10:12:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-bd458272-3fd9-49da-b8eb-11454f26a02f tempest-TestServerVolumeAttachScenarioOldVersion-1315851295 None] Lock "cinder-fc8ff827-85d3-4d42-be62-db9c5a0c1647-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Flow 'volume_create_manager' (463f247c-7ec8-4752-a915-82284863f746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43daae60-ee2d-4ff6-8be9-5c9783f41939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43daae60-ee2d-4ff6-8be9-5c9783f41939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1455913298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d418cd8f-7fc3-4e0d-a02b-691124aa3f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e3833f756349b79a972ffc4e16efaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:46Z,use_quota=True,user_id='5590d6e48e0c44a6b694667e0a7c7536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bec0458-5a30-4895-87b1-4f7ee708f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bec0458-5a30-4895-87b1-4f7ee708f63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b42d75e-88cd-48be-a5c9-751a03283ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b42d75e-88cd-48be-a5c9-751a03283ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd418cd8f-7fc3-4e0d-a02b-691124aa3f35', 'volume_name': 'volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867585b0-28fa-46e5-bfb9-bc5391097962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867585b0-28fa-46e5-bfb9-bc5391097962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b963cc-e476-48e3-b810-5d708339a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Volume d418cd8f-7fc3-4e0d-a02b-691124aa3f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35', 'volume_size': 1} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1455913298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d418cd8f-7fc3-4e0d-a02b-691124aa3f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e3833f756349b79a972ffc4e16efaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:46Z,use_quota=True,user_id='5590d6e48e0c44a6b694667e0a7c7536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Creating volume d418cd8f-7fc3-4e0d-a02b-691124aa3f35 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:12:46 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:46 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 1073741824 Nov 02 10:12:46 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:46 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 1073741824" returned: 0 in 0.552s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:12:46 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 Nov 02 10:12:46 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:12:47 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Nov 02 10:12:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35" returned: 0 in 0.303s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:12:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:12:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b963cc-e476-48e3-b810-5d708339a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e1a817-6e4c-40ea-8d4f-98b06e955025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:12:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Volume volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 (d418cd8f-7fc3-4e0d-a02b-691124aa3f35): created successfully Nov 02 10:12:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e1a817-6e4c-40ea-8d4f-98b06e955025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:12:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Flow 'volume_create_manager' (463f247c-7ec8-4752-a915-82284863f746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:12:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3cb798da-8533-43c4-9582-5869ea1d7321 tempest-AttachVolumeNegativeTest-1835097764 None] Created volume successfully. Nov 02 10:12:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-cafc43c3-0750-4fd6-9f9c-ab90e88bd513 req-06717646-9609-4982-a196-6ea7dda342a3 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:12:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-cafc43c3-0750-4fd6-9f9c-ab90e88bd513 req-06717646-9609-4982-a196-6ea7dda342a3 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:12:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-cafc43c3-0750-4fd6-9f9c-ab90e88bd513 req-06717646-9609-4982-a196-6ea7dda342a3 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:12:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-cafc43c3-0750-4fd6-9f9c-ab90e88bd513 req-06717646-9609-4982-a196-6ea7dda342a3 tempest-AttachVolumeNegativeTest-1835097764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c5a26ad-3051-4366-80b8-31b8aa802f53', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:12:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-cafc43c3-0750-4fd6-9f9c-ab90e88bd513 req-06717646-9609-4982-a196-6ea7dda342a3 tempest-AttachVolumeNegativeTest-1835097764 None] attachment_update completed successfully. Nov 02 10:12:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-2600af13-d82f-4ed1-ba5d-007eba31f067 req-cf02be8f-a01c-4e9d-adb6-86cce3f685c6 tempest-AttachVolumeNegativeTest-1835097764 None] Terminate volume connection completed successfully. Nov 02 10:12:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-2600af13-d82f-4ed1-ba5d-007eba31f067 req-cf02be8f-a01c-4e9d-adb6-86cce3f685c6 tempest-AttachVolumeNegativeTest-1835097764 None] Deleting attachment 7c5a26ad-3051-4366-80b8-31b8aa802f53. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:13:02 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=24,cinder:SELECT=38,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:02 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=42,cinder:INSERT=9,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:13:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:20 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:13:20 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:21 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.299s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:13:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:13:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:13:24 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-245d1c43-1a2c-4d11-8ede-c0587dec5b12 req-8d3331ff-4698-4910-8b19-e430a779340c tempest-TestShelveInstance-923075576 None] Terminate volume connection completed successfully. Nov 02 10:13:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-245d1c43-1a2c-4d11-8ede-c0587dec5b12 req-8d3331ff-4698-4910-8b19-e430a779340c tempest-TestShelveInstance-923075576 None] Deleting attachment 90987f90-53d7-4398-9f79-bbbcf97dd6f3. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:13:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-0a8307f1-e5f1-4841-a2dc-b49556013c33 req-964be14d-24b0-4927-975a-de04f0dcaad3 tempest-TestShelveInstance-923075576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-0a8307f1-e5f1-4841-a2dc-b49556013c33 req-964be14d-24b0-4927-975a-de04f0dcaad3 tempest-TestShelveInstance-923075576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-0a8307f1-e5f1-4841-a2dc-b49556013c33 req-964be14d-24b0-4927-975a-de04f0dcaad3 tempest-TestShelveInstance-923075576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-0a8307f1-e5f1-4841-a2dc-b49556013c33 req-964be14d-24b0-4927-975a-de04f0dcaad3 tempest-TestShelveInstance-923075576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eda7998e-caa6-4452-82cd-2eac749e992a', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:13:27 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-0a8307f1-e5f1-4841-a2dc-b49556013c33 req-964be14d-24b0-4927-975a-de04f0dcaad3 tempest-TestShelveInstance-923075576 None] attachment_update completed successfully. Nov 02 10:13:37 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Flow 'volume_create_manager' (01a9eb5c-6dfb-4a44-98f8-98e09dc08b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62dcefdc-7b71-4d8a-b2c5-194d3118c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62dcefdc-7b71-4d8a-b2c5-194d3118c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1830758423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0e1c6a-6136-420d-ba16-c53bcf3bfd92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e3833f756349b79a972ffc4e16efaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:35Z,use_quota=True,user_id='5590d6e48e0c44a6b694667e0a7c7536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88782a78-5e34-44f4-bb66-356aebc45840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88782a78-5e34-44f4-bb66-356aebc45840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba8ced2-cce9-4a06-999b-6dc48f592102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba8ced2-cce9-4a06-999b-6dc48f592102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0e1c6a-6136-420d-ba16-c53bcf3bfd92', 'volume_name': 'volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c4bfb2-744d-48c7-ac84-530954a47f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c4bfb2-744d-48c7-ac84-530954a47f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792d7f1a-3e6b-4663-95ad-0544109c6ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:39 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Volume ea0e1c6a-6136-420d-ba16-c53bcf3bfd92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92', 'volume_size': 1} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1830758423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0e1c6a-6136-420d-ba16-c53bcf3bfd92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e3833f756349b79a972ffc4e16efaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:35Z,use_quota=True,user_id='5590d6e48e0c44a6b694667e0a7c7536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Creating volume ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:39 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:13:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:39 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 1073741824 Nov 02 10:13:39 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:40 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 1073741824" returned: 0 in 0.538s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:40 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 Nov 02 10:13:40 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:40 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92" returned: 0 in 0.285s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792d7f1a-3e6b-4663-95ad-0544109c6ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349bee31-ac89-4508-b441-4ca674a27b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:40 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Volume volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 (ea0e1c6a-6136-420d-ba16-c53bcf3bfd92): created successfully Nov 02 10:13:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349bee31-ac89-4508-b441-4ca674a27b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Flow 'volume_create_manager' (01a9eb5c-6dfb-4a44-98f8-98e09dc08b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:40 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e1c39029-f959-4cf7-84e6-e59e41d87352 tempest-AttachVolumeNegativeTest-1835097764 None] Created volume successfully. Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Flow 'volume_create_manager' (509f30fa-bdf4-45d0-8d14-486879e978e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1737dc-0e23-4b66-8f75-d964744f8ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1737dc-0e23-4b66-8f75-d964744f8ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-120872425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75329959-b6f3-4144-9a5e-eb00b9fe5cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0242df5b1e4551a89383dcd3a985b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:41Z,use_quota=True,user_id='18eced4e90fd48f1b33a655dbd657fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b548fa8-2377-45ed-a283-16cce898154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b548fa8-2377-45ed-a283-16cce898154e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144eadbb-5321-48b6-aa2d-ca4ff0b6af48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144eadbb-5321-48b6-aa2d-ca4ff0b6af48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75329959-b6f3-4144-9a5e-eb00b9fe5cb0', 'volume_name': 'volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2eb9468-0993-4064-90ac-6652b2558de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2eb9468-0993-4064-90ac-6652b2558de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e5f1cf-5620-4cbc-966a-0917a442ce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:41 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Volume 75329959-b6f3-4144-9a5e-eb00b9fe5cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0', 'volume_size': 1} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-120872425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75329959-b6f3-4144-9a5e-eb00b9fe5cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0242df5b1e4551a89383dcd3a985b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:41Z,use_quota=True,user_id='18eced4e90fd48f1b33a655dbd657fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Creating volume 75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:13:41 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:13:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:41 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 1073741824 Nov 02 10:13:41 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-7ea09779-d98b-4735-9450-38962681434b req-ba54523c-a7d3-4d79-9395-5e2763c38dea tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:42 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 1073741824" returned: 0 in 0.611s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:42 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 Nov 02 10:13:42 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:42 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" returned: 0 in 0.334s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-7ea09779-d98b-4735-9450-38962681434b req-ba54523c-a7d3-4d79-9395-5e2763c38dea tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.511s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-7ea09779-d98b-4735-9450-38962681434b req-ba54523c-a7d3-4d79-9395-5e2763c38dea tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e5f1cf-5620-4cbc-966a-0917a442ce4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5542f3bb-4382-4654-9c97-247ae7ed7cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:13:42 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Volume volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 (75329959-b6f3-4144-9a5e-eb00b9fe5cb0): created successfully Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5542f3bb-4382-4654-9c97-247ae7ed7cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Flow 'volume_create_manager' (509f30fa-bdf4-45d0-8d14-486879e978e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:13:42 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-85063704-6349-4365-9dc4-5f5cd58e1d50 tempest-TestStampPattern-274963852 None] Created volume successfully. Nov 02 10:13:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-7ea09779-d98b-4735-9450-38962681434b req-ba54523c-a7d3-4d79-9395-5e2763c38dea tempest-AttachVolumeNegativeTest-1835097764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01bfa1b9-4f20-4e8b-9a00-e37e905e6fec', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:13:42 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-7ea09779-d98b-4735-9450-38962681434b req-ba54523c-a7d3-4d79-9395-5e2763c38dea tempest-AttachVolumeNegativeTest-1835097764 None] attachment_update completed successfully. Nov 02 10:13:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-9e9ac128-f8cc-4c93-8b6b-b1ae8f0ee87b req-39c763a0-f75a-41ab-ac2e-0c43281721f5 tempest-AttachVolumeNegativeTest-1835097764 None] Terminate volume connection completed successfully. Nov 02 10:13:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-9e9ac128-f8cc-4c93-8b6b-b1ae8f0ee87b req-39c763a0-f75a-41ab-ac2e-0c43281721f5 tempest-AttachVolumeNegativeTest-1835097764 None] Deleting attachment 01bfa1b9-4f20-4e8b-9a00-e37e905e6fec. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:13:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "cinder-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "cinder-quobyte-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-quobyte-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92" acquired by "delete_volume" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:51 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8efeea-2f39-4fae-9ca3-d1a1a34437a5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:51 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 Nov 02 10:13:51 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:51 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92" returned: 0 in 0.443s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:51 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92 Nov 02 10:13:51 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:52 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92" returned: 0 in 0.264s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-quobyte-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92" released by "delete_volume" :: held 0.773s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Created reservations ['ed88fd3d-b8cc-4d04-b69b-f2b68af3da82', '6a7c4bec-7a4e-4dc3-9ff7-ca4a6cfcbc97', '25228f91-1710-4bbd-84fa-545fc4275369', 'd035fa7b-328f-40e0-b505-2a7f1686159e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:52 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:13:52 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "cinder-d418cd8f-7fc3-4e0d-a02b-691124aa3f35-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-d418cd8f-7fc3-4e0d-a02b-691124aa3f35-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "cinder-quobyte-d418cd8f-7fc3-4e0d-a02b-691124aa3f35" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-quobyte-d418cd8f-7fc3-4e0d-a02b-691124aa3f35" acquired by "delete_volume" :: waited 0.037s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[003652d4-a8a6-421b-8710-9e54578d12d2]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:52 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.501s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:52 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Deleted volume successfully. Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5ba67498-b003-4e29-bc3a-2d6429c8ccf1 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-ea0e1c6a-6136-420d-ba16-c53bcf3bfd92-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:53 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 Nov 02 10:13:53 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:53 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35" returned: 0 in 0.503s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:53 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35 Nov 02 10:13:53 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:53 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d418cd8f-7fc3-4e0d-a02b-691124aa3f35" returned: 0 in 0.290s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-quobyte-d418cd8f-7fc3-4e0d-a02b-691124aa3f35" released by "delete_volume" :: held 0.858s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Created reservations ['5ae5e99f-34ca-436f-9efd-1e66de191820', 'e2c8bfdd-ad94-4490-8ad3-a8e08dfd0fd3', 'ee3739b0-71b3-4c55-88c2-f0021c86b16e', '1876ccb3-03b1-4321-ab56-0ab4f385b905'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:53 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:13:53 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:54 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.337s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:54 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Deleted volume successfully. Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a976fc87-8660-48e1-b7c7-69994e799548 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-d418cd8f-7fc3-4e0d-a02b-691124aa3f35-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "cinder-57b7de6a-3365-461a-8586-8063401c7d59-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-57b7de6a-3365-461a-8586-8063401c7d59-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "cinder-quobyte-57b7de6a-3365-461a-8586-8063401c7d59" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-quobyte-57b7de6a-3365-461a-8586-8063401c7d59" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca30de1-fcbd-4df3-bd77-cb897bdbf1e0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:54 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59 Nov 02 10:13:54 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:54 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59" returned: 0 in 0.458s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:55 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59 Nov 02 10:13:55 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:55 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57b7de6a-3365-461a-8586-8063401c7d59" returned: 0 in 0.352s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-quobyte-57b7de6a-3365-461a-8586-8063401c7d59" released by "delete_volume" :: held 0.872s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Created reservations ['5a3ceb4e-247d-4eee-8ee2-9291607ad3a2', 'e48f91ab-ba32-47c6-b0ed-f5083b6d4277', 'a036bf3e-0734-4138-a3fc-cdc521c531c6', '2c9bae8f-d396-4e37-9428-2f6c794151b6'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:13:55 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:13:55 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:13:55 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.318s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:13:55 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:13:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Deleted volume successfully. Nov 02 10:13:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-57d56d20-9f9c-40ed-849f-a6a8642ff540 tempest-AttachVolumeNegativeTest-1835097764 None] Lock "cinder-57b7de6a-3365-461a-8586-8063401c7d59-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:05 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-18e0225d-c5b0-435e-b393-977db607d9a5 tempest-GroupSnapshotsTest-1888253042 None] Group tempest-GroupSnapshotsTest-Group-1307143748: creating Nov 02 10:14:05 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-18e0225d-c5b0-435e-b393-977db607d9a5 tempest-GroupSnapshotsTest-1888253042 None] Group tempest-GroupSnapshotsTest-Group-1307143748: created successfully Nov 02 10:14:05 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-18e0225d-c5b0-435e-b393-977db607d9a5 tempest-GroupSnapshotsTest-1888253042 None] Create group completed successfully. Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Flow 'volume_create_manager' (4cc0319b-4f3f-4705-ac69-e0807647f5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d442f7-49a2-489c-aeaf-3489f0c2d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d442f7-49a2-489c-aeaf-3489f0c2d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900135985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c800428-f164-410d-9dce-32776f5e7a63,host='devstack@QuobyteHD#QuobyteHD',id=4aae5eca-c295-4a85-bac2-7fd3cafe92b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc35b64c2e4c496a9eef008d98030bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:07Z,use_quota=True,user_id='11421927a5b64acda6ee9d6c6d85f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72843c0c-3f75-4b2e-8f27-554ab8b56543),volume_type_id=72843c0c-3f75-4b2e-8f27-554ab8b56543)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e610cc2-716c-4c63-9718-c266aea9d010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e610cc2-716c-4c63-9718-c266aea9d010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bac231a-a1dc-4825-ad08-9d484709bf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bac231a-a1dc-4825-ad08-9d484709bf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aae5eca-c295-4a85-bac2-7fd3cafe92b7', 'volume_name': 'volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddda7a09-807c-487e-9e2a-cfd436f19334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddda7a09-807c-487e-9e2a-cfd436f19334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ffb682-cff0-427e-b37d-7df5d481b75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:06 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Volume 4aae5eca-c295-4a85-bac2-7fd3cafe92b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7', 'volume_size': 1} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1c800428-f164-410d-9dce-32776f5e7a63,created_at=2026-11-02T09:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900135985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1c800428-f164-410d-9dce-32776f5e7a63,host='devstack@QuobyteHD#QuobyteHD',id=4aae5eca-c295-4a85-bac2-7fd3cafe92b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc35b64c2e4c496a9eef008d98030bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:07Z,use_quota=True,user_id='11421927a5b64acda6ee9d6c6d85f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72843c0c-3f75-4b2e-8f27-554ab8b56543),volume_type_id=72843c0c-3f75-4b2e-8f27-554ab8b56543)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Creating volume 4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:06 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:14:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:06 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 1073741824 Nov 02 10:14:06 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:07 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 1073741824" returned: 0 in 0.456s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:07 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 Nov 02 10:14:07 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:07 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" returned: 0 in 0.251s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ffb682-cff0-427e-b37d-7df5d481b75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf0d740-74e2-4136-ae1e-9bff5606081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Volume volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 (4aae5eca-c295-4a85-bac2-7fd3cafe92b7): created successfully Nov 02 10:14:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf0d740-74e2-4136-ae1e-9bff5606081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Flow 'volume_create_manager' (4cc0319b-4f3f-4705-ac69-e0807647f5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-852716ae-22ba-4071-9860-d5fd7d73764f tempest-GroupSnapshotsTest-1888253042 None] Created volume successfully. Nov 02 10:14:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] GroupSnapshot 6c65bffe-b5a5-44ad-a5e6-10445f08ad15: creating. Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Group snapshot 6c65bffe-b5a5-44ad-a5e6-10445f08ad15: creating. {{(pid=86840) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Creating offline snapshot 881d4dcc-997e-4406-8d87-8cb58274eac8 of volume 4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c568e2bb-16e9-40cf-a943-9e90586f10fa]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:08 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 Nov 02 10:14:08 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:08 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" returned: 0 in 0.359s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:08 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 1G Nov 02 10:14:08 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:08 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 1G" returned: 0 in 0.403s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:08 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 Nov 02 10:14:08 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:09 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8" returned: 0 in 0.308s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:09 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:14:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:09 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 Nov 02 10:14:09 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:09 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8" returned: 0 in 0.250s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:09 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.info Nov 02 10:14:09 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:09 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.info" returned: 0 in 0.252s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:09 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:14:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:09 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.info Nov 02 10:14:09 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:09 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.info" returned: 0 in 0.264s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2f947fae-6252-4160-8905-ce67fa44efef tempest-GroupSnapshotsTest-1888253042 None] group_snapshot 6c65bffe-b5a5-44ad-a5e6-10445f08ad15: created successfully Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-881d4dcc-997e-4406-8d87-8cb58274eac8-341bbc03-0264-4abe-8739-d58c07a2ba65" by "_create_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-881d4dcc-997e-4406-8d87-8cb58274eac8-341bbc03-0264-4abe-8739-d58c07a2ba65" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Creating volume 341bbc03-0264-4abe-8739-d58c07a2ba65 from snapshot 881d4dcc-997e-4406-8d87-8cb58274eac8 {{(pid=86840) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-341bbc03-0264-4abe-8739-d58c07a2ba65" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-341bbc03-0264-4abe-8739-d58c07a2ba65" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] snapshot: 881d4dcc-997e-4406-8d87-8cb58274eac8, volume: 341bbc03-0264-4abe-8739-d58c07a2ba65, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[78da5258-77f8-45b2-af08-4ea7002dfca7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:11 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 Nov 02 10:14:11 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:11 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8" returned: 0 in 0.514s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[651d8175-332f-4098-9b64-c53b548cdae3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:11 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 Nov 02 10:14:11 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:12 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" returned: 0 in 0.493s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:14:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:14:12 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:14:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:12 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 Nov 02 10:14:12 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:14 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-4094c4b7-457f-43f4-97e9-fe7e780f16a1 tempest-TestShelveInstance-923075576 None] Terminate volume connection completed successfully. Nov 02 10:14:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-4094c4b7-457f-43f4-97e9-fe7e780f16a1 tempest-TestShelveInstance-923075576 None] Deleting attachment eda7998e-caa6-4452-82cd-2eac749e992a. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:14:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Acquiring lock "cinder-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Lock "cinder-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Acquiring lock "cinder-quobyte-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Lock "cinder-quobyte-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:14 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbfaa17-a6a3-4da5-96f8-2491103cb0e4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:14 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 Nov 02 10:14:14 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:15 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6" returned: 0 in 0.826s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:15 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6 Nov 02 10:14:15 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:15 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6" returned: 0 in 0.352s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Lock "cinder-quobyte-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6" released by "delete_volume" :: held 1.278s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:15 devstack cinder-volume[86840]: DEBUG cinder.quota [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Created reservations ['45c5e91d-16fc-4e14-a351-93fe8faabcd7', 'bbcd44d3-0c22-499c-a527-11dd71d3ef87', 'a986253a-4aba-418b-926e-569b36ecde6e', 'a162ea57-5d20-4b06-bb9c-9b1d45519d6e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:16 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:14:16 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:16 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.578s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:16 devstack cinder-volume[86840]: DEBUG cinder.manager [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:16 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Deleted volume successfully. Nov 02 10:14:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [req-b7076fdb-c08e-4a29-abba-e81ad2e42ba5 req-b7e91d22-1761-4e2c-9106-ca148c2b25b9 tempest-TestShelveInstance-923075576 None] Lock "cinder-7d3e3d60-2c5b-4a66-bc08-598c0c1e23f6-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-15d212a5-7254-4a5e-9e6f-3723ff7c3147 req-8eae24ec-d5ec-498f-8fd2-37dc6a8df1c5 tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:20 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65" returned: 0 in 7.937s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7, size 1024.00 MB, duration 7.94 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:20 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Converted 1024.00 MB image at 129.00 MB/s Nov 02 10:14:20 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:20 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 Nov 02 10:14:20 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:20 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65" returned: 0 in 0.271s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-341bbc03-0264-4abe-8739-d58c07a2ba65" released by "_copy_volume_from_snapshot" :: held 9.362s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-881d4dcc-997e-4406-8d87-8cb58274eac8-341bbc03-0264-4abe-8739-d58c07a2ba65" released by "_create_volume_from_snapshot" :: held 9.451s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.477s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-15d212a5-7254-4a5e-9e6f-3723ff7c3147 req-8eae24ec-d5ec-498f-8fd2-37dc6a8df1c5 tempest-TestStampPattern-274963852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.716s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-15d212a5-7254-4a5e-9e6f-3723ff7c3147 req-8eae24ec-d5ec-498f-8fd2-37dc6a8df1c5 tempest-TestStampPattern-274963852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-15d212a5-7254-4a5e-9e6f-3723ff7c3147 req-8eae24ec-d5ec-498f-8fd2-37dc6a8df1c5 tempest-TestStampPattern-274963852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '774f31fb-8867-4ea2-90a0-639a88d18617', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:14:20 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-77fa6922-470b-4f6f-acd6-d73dd838aab6 tempest-GroupSnapshotsTest-1888253042 None] Create group from source-snapshot-6c65bffe-b5a5-44ad-a5e6-10445f08ad15 completed successfully. Nov 02 10:14:20 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-15d212a5-7254-4a5e-9e6f-3723ff7c3147 req-8eae24ec-d5ec-498f-8fd2-37dc6a8df1c5 tempest-TestStampPattern-274963852 None] attachment_update completed successfully. Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:20 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:14:20 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:21 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:14:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:14:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:14:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-341bbc03-0264-4abe-8739-d58c07a2ba65" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-341bbc03-0264-4abe-8739-d58c07a2ba65" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:21 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d44ed60-40f8-4002-ae47-295f1fe12340]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:21 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 Nov 02 10:14:21 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:22 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65" returned: 0 in 0.492s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:22 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65 Nov 02 10:14:22 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:22 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-341bbc03-0264-4abe-8739-d58c07a2ba65" returned: 0 in 0.261s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-341bbc03-0264-4abe-8739-d58c07a2ba65" released by "delete_volume" :: held 0.822s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=62,cinder:UPDATE=60,cinder:DELETE=4,cinder:INSERT=13 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['03909f1c-cc9a-4535-a500-824f861f61f7'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:22 devstack cinder-volume[86840]: WARNING cinder.quota [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-682562086 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-682562086, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:14:22 devstack cinder-volume[86840]: WARNING cinder.quota [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-682562086 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-682562086, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['fb698668-d445-4b84-952c-7ba1bb59aeb0', '1d43fa2b-cdd5-427d-a5ca-035c535ea2dc', 'f0802a71-a36c-42ea-800e-7b8bd1e3954b', '1d800622-9f93-4d34-95d5-e981c9c6f695'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:22 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:14:22 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:22 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:22 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] group_snapshot 6c65bffe-b5a5-44ad-a5e6-10445f08ad15: deleting Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.328s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:22 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0226c948-0451-48a4-9cec-593b792e0679 tempest-GroupSnapshotsTest-1888253042 None] Delete group completed successfully. Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] group_snapshot 6c65bffe-b5a5-44ad-a5e6-10445f08ad15: deleting {{(pid=86840) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:14:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-881d4dcc-997e-4406-8d87-8cb58274eac8" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-881d4dcc-997e-4406-8d87-8cb58274eac8" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Deleting offline snapshot 881d4dcc-997e-4406-8d87-8cb58274eac8 of volume 4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] snapshot_file for this snap is: volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1abade-d9ea-43e0-a177-c2e7d7ca7c3e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:23 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 Nov 02 10:14:23 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:23 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8" returned: 0 in 0.466s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8177bc9a-313c-448e-b6cd-779954107464]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:23 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 Nov 02 10:14:23 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:24 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" returned: 0 in 0.698s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:24 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 Nov 02 10:14:24 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:24 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8" returned: 0 in 0.481s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:24 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8 Nov 02 10:14:24 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:25 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7.881d4dcc-997e-4406-8d87-8cb58274eac8" returned: 0 in 0.373s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-881d4dcc-997e-4406-8d87-8cb58274eac8" released by "_delete_snapshot" :: held 2.200s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" released by "delete_snapshot" :: held 2.258s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:25 devstack cinder-volume[86840]: WARNING cinder.quota [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-682562086 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-682562086, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:14:25 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['82e25e51-8211-4366-ab11-ae9be6a0a9eb', 'fca9d19e-8b25-4c27-8f40-435595550521', '85502d79-397e-4e12-8174-850b4c0ad7e6', '351d541e-5038-4fb4-a961-27e45792819a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-41703cf1-127f-48dd-9dad-32341c617a81 tempest-GroupSnapshotsTest-1888253042 None] group_snapshot 6c65bffe-b5a5-44ad-a5e6-10445f08ad15: deleted successfully Nov 02 10:14:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-1ed01911-abae-4b95-90e6-8dd35aaee836 req-11f6e3a3-9168-462a-a0c1-765ea1ac6812 tempest-TestStampPattern-274963852 None] Terminate volume connection completed successfully. Nov 02 10:14:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-1ed01911-abae-4b95-90e6-8dd35aaee836 req-11f6e3a3-9168-462a-a0c1-765ea1ac6812 tempest-TestStampPattern-274963852 None] Deleting attachment 774f31fb-8867-4ea2-90a0-639a88d18617. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:14:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:26 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[80304204-fda4-4ace-be4d-5826cd2a91ef]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 Nov 02 10:14:27 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Creating offline snapshot 6f26c68c-c9d6-465e-90dc-25216cd309f0 of volume 75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba7ab21-3e98-4e9d-b628-f9b7f0c52a69]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" returned: 0 in 0.451s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7 Nov 02 10:14:27 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:27 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 Nov 02 10:14:27 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:27 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" returned: 0 in 0.264s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-4aae5eca-c295-4a85-bac2-7fd3cafe92b7" released by "delete_volume" :: held 0.835s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['cf47aad6-a13d-49f1-b5c1-21ec4670f779'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:27 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" returned: 0 in 0.453s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 1G Nov 02 10:14:27 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:27 devstack cinder-volume[86840]: WARNING cinder.db.api [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-682562086'] Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['e6d1e5d5-6a29-48e2-9f22-dc4ac76d8d42', '3dc4a331-e586-4be8-8489-35edc802f7e6', '1cae4470-4f50-4ae7-9120-202e46362813', '6c1d765a-6bfa-404f-98c7-b702a1f35bd1'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:27 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:14:27 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:28 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.259s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:28 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:14:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-04af8947-8627-42af-a642-50aa72d81866 tempest-GroupSnapshotsTest-1888253042 None] Delete group completed successfully. Nov 02 10:14:28 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 1G" returned: 0 in 0.454s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:28 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 Nov 02 10:14:28 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-442ae974-fd98-4f08-a00b-6d928263e11a tempest-GroupSnapshotsTest-1888253042 None] Group tempest-GroupSnapshotsTest-Group-135684499: creating Nov 02 10:14:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-442ae974-fd98-4f08-a00b-6d928263e11a tempest-GroupSnapshotsTest-1888253042 None] Group tempest-GroupSnapshotsTest-Group-135684499: created successfully Nov 02 10:14:28 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0" returned: 0 in 0.357s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:28 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 is being set with open permissions: ugo+rw Nov 02 10:14:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-442ae974-fd98-4f08-a00b-6d928263e11a tempest-GroupSnapshotsTest-1888253042 None] Create group completed successfully. Nov 02 10:14:28 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 Nov 02 10:14:28 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:28 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0" returned: 0 in 0.284s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:28 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.info Nov 02 10:14:28 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:29 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.info" returned: 0 in 0.261s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:29 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.info is being set with open permissions: ugo+rw Nov 02 10:14:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:29 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.info Nov 02 10:14:29 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:29 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.info" returned: 0 in 0.275s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:29 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5f2a04a6-f6a4-49be-b41f-e24b54952604 tempest-TestStampPattern-274963852 None] Create snapshot completed successfully Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Flow 'volume_create_manager' (4709a693-9c96-4570-b9ed-de878a047319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2ea0b8-5696-4019-b244-cdf2a50f9640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2ea0b8-5696-4019-b244-cdf2a50f9640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-99191541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=188e7fa9-0da2-48d4-8a4b-7f3f5809feeb,host='devstack@QuobyteHD#QuobyteHD',id=4a966fa4-41d3-4e1f-b4f7-9fca5291159d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc35b64c2e4c496a9eef008d98030bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:30Z,use_quota=True,user_id='11421927a5b64acda6ee9d6c6d85f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fec50cf1-2291-42e4-92e6-19c8a23fdd2c),volume_type_id=fec50cf1-2291-42e4-92e6-19c8a23fdd2c)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec06a81-f760-41de-a001-1776bfd09622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec06a81-f760-41de-a001-1776bfd09622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dda9457-4af4-45f9-94bb-8a7b83f3bc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dda9457-4af4-45f9-94bb-8a7b83f3bc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a966fa4-41d3-4e1f-b4f7-9fca5291159d', 'volume_name': 'volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab76242-5c9b-44b5-812b-9295fea299b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab76242-5c9b-44b5-812b-9295fea299b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4882be81-7f0d-4023-997c-37744ea93430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:30 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Volume 4a966fa4-41d3-4e1f-b4f7-9fca5291159d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d', 'volume_size': 1} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=188e7fa9-0da2-48d4-8a4b-7f3f5809feeb,created_at=2026-11-02T09:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-99191541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=188e7fa9-0da2-48d4-8a4b-7f3f5809feeb,host='devstack@QuobyteHD#QuobyteHD',id=4a966fa4-41d3-4e1f-b4f7-9fca5291159d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc35b64c2e4c496a9eef008d98030bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:30Z,use_quota=True,user_id='11421927a5b64acda6ee9d6c6d85f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fec50cf1-2291-42e4-92e6-19c8a23fdd2c),volume_type_id=fec50cf1-2291-42e4-92e6-19c8a23fdd2c)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Creating volume 4a966fa4-41d3-4e1f-b4f7-9fca5291159d {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:30 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:30 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d 1073741824 Nov 02 10:14:30 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:30 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d 1073741824" returned: 0 in 0.524s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:30 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d Nov 02 10:14:30 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:31 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" returned: 0 in 0.285s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4882be81-7f0d-4023-997c-37744ea93430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b297d3c-b22d-4bc6-83f1-81312e787fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:31 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Volume volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d (4a966fa4-41d3-4e1f-b4f7-9fca5291159d): created successfully Nov 02 10:14:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b297d3c-b22d-4bc6-83f1-81312e787fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Flow 'volume_create_manager' (4709a693-9c96-4570-b9ed-de878a047319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-12ab481f-6da1-48fd-953f-2f176a333a5c tempest-GroupSnapshotsTest-1888253042 None] Created volume successfully. Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Flow 'volume_create_manager' (4fd1096d-efbd-4edb-8fa5-a4f10e18e226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a4cc3c-f7f5-49a7-a4ef-78a0582f45ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a4cc3c-f7f5-49a7-a4ef-78a0582f45ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-230526137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=188e7fa9-0da2-48d4-8a4b-7f3f5809feeb,host='devstack@QuobyteHD#QuobyteHD',id=57098713-c2d4-48b5-9207-b32785423144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc35b64c2e4c496a9eef008d98030bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:32Z,use_quota=True,user_id='11421927a5b64acda6ee9d6c6d85f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fec50cf1-2291-42e4-92e6-19c8a23fdd2c),volume_type_id=fec50cf1-2291-42e4-92e6-19c8a23fdd2c)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c17323-ffac-4193-a4ac-b73de91d1c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c17323-ffac-4193-a4ac-b73de91d1c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e399eeda-099d-44fe-8ecb-74b5ef949f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e399eeda-099d-44fe-8ecb-74b5ef949f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57098713-c2d4-48b5-9207-b32785423144', 'volume_name': 'volume-57098713-c2d4-48b5-9207-b32785423144', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca38b1af-8de9-47c4-b6ee-191bc4f81df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca38b1af-8de9-47c4-b6ee-191bc4f81df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475ad1f0-b809-4b97-9c4e-b26ea03380bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:32 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Volume 57098713-c2d4-48b5-9207-b32785423144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57098713-c2d4-48b5-9207-b32785423144', 'volume_size': 1} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=188e7fa9-0da2-48d4-8a4b-7f3f5809feeb,created_at=2026-11-02T09:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-230526137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=188e7fa9-0da2-48d4-8a4b-7f3f5809feeb,host='devstack@QuobyteHD#QuobyteHD',id=57098713-c2d4-48b5-9207-b32785423144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc35b64c2e4c496a9eef008d98030bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:32Z,use_quota=True,user_id='11421927a5b64acda6ee9d6c6d85f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fec50cf1-2291-42e4-92e6-19c8a23fdd2c),volume_type_id=fec50cf1-2291-42e4-92e6-19c8a23fdd2c)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Creating volume 57098713-c2d4-48b5-9207-b32785423144 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:32 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:32 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 1073741824 Nov 02 10:14:32 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:32 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 1073741824" returned: 0 in 0.545s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:32 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 Nov 02 10:14:32 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:33 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144" returned: 0 in 0.253s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:14:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475ad1f0-b809-4b97-9c4e-b26ea03380bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57098713-c2d4-48b5-9207-b32785423144', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db33e88-4f57-4a1c-87a8-8e8fb5dede4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:33 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Volume volume-57098713-c2d4-48b5-9207-b32785423144 (57098713-c2d4-48b5-9207-b32785423144): created successfully Nov 02 10:14:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db33e88-4f57-4a1c-87a8-8e8fb5dede4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Flow 'volume_create_manager' (4fd1096d-efbd-4edb-8fa5-a4f10e18e226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7125da07-5605-4261-b1cc-565939436528 tempest-GroupSnapshotsTest-1888253042 None] Created volume successfully. Nov 02 10:14:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6c9c9c40-a0d9-43bc-94cd-31a89484d1f2 tempest-GroupSnapshotsTest-1888253042 None] Update group completed successfully. Nov 02 10:14:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2ce8c4c9-3c7c-47fb-b585-19943a7066d1 tempest-GroupSnapshotsTest-1888253042 None] Update group completed successfully. Nov 02 10:14:36 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-827a0d70-8c0c-40f9-84ac-61b857551a8b tempest-GroupSnapshotsTest-1888253042 None] Update group completed successfully. Nov 02 10:14:37 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5f0680ea-7cec-400d-a43d-f8e74238ac95 tempest-GroupSnapshotsTest-1888253042 None] Update group completed successfully. Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Flow 'volume_create_manager' (32c55377-50d0-4409-bd67-4fad208a9e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0548fdf0-c625-4c4d-8fdb-e47f582f01c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0548fdf0-c625-4c4d-8fdb-e47f582f01c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1146074526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da52d51-7b46-43c9-8dfb-cdc23a768686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0242df5b1e4551a89383dcd3a985b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f26c68c-c9d6-465e-90dc-25216cd309f0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:39Z,use_quota=True,user_id='18eced4e90fd48f1b33a655dbd657fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04f47b7-6485-499d-b2e1-13771e0626ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04f47b7-6485-499d-b2e1-13771e0626ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409aa495-90b0-4474-8d0d-635b0fd1de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409aa495-90b0-4474-8d0d-635b0fd1de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8da52d51-7b46-43c9-8dfb-cdc23a768686', 'volume_name': 'volume-8da52d51-7b46-43c9-8dfb-cdc23a768686', 'volume_size': 1, 'snapshot_id': '6f26c68c-c9d6-465e-90dc-25216cd309f0'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e992f81-14e6-48a6-8beb-1dbf7939e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e992f81-14e6-48a6-8beb-1dbf7939e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eea3a92-a62a-4fb1-a0c2-9921efe7a993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:38 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Volume 8da52d51-7b46-43c9-8dfb-cdc23a768686: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8da52d51-7b46-43c9-8dfb-cdc23a768686', 'volume_size': 1, 'snapshot_id': '6f26c68c-c9d6-465e-90dc-25216cd309f0'} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Acquiring lock "cinder-quobyte-6f26c68c-c9d6-465e-90dc-25216cd309f0-8da52d51-7b46-43c9-8dfb-cdc23a768686" by "_create_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-6f26c68c-c9d6-465e-90dc-25216cd309f0-8da52d51-7b46-43c9-8dfb-cdc23a768686" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Creating volume 8da52d51-7b46-43c9-8dfb-cdc23a768686 from snapshot 6f26c68c-c9d6-465e-90dc-25216cd309f0 {{(pid=86840) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Acquiring lock "cinder-quobyte-8da52d51-7b46-43c9-8dfb-cdc23a768686" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-8da52d51-7b46-43c9-8dfb-cdc23a768686" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] snapshot: 6f26c68c-c9d6-465e-90dc-25216cd309f0, volume: 8da52d51-7b46-43c9-8dfb-cdc23a768686, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d822d61-75f5-4ef4-b778-ed83d2bbf2e1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:39 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 Nov 02 10:14:39 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] GroupSnapshot 7d30dad0-ccac-490f-873e-a2f93edd95a9: creating. Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Group snapshot 7d30dad0-ccac-490f-873e-a2f93edd95a9: creating. {{(pid=86840) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:39 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0" returned: 0 in 0.509s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50066d6-d05c-495c-a577-e6105f0a9a51]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:39 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 Nov 02 10:14:39 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:40 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" returned: 0 in 0.467s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:14:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:14:40 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:14:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:40 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 Nov 02 10:14:40 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:49 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=41,cinder:INSERT=6,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:14:49 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=104,cinder:INSERT=19,cinder:UPDATE=82,cinder:DELETE=5 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:14:49 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686" returned: 0 in 9.918s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:49 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0, size 1024.00 MB, duration 9.92 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:14:49 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Converted 1024.00 MB image at 103.24 MB/s Nov 02 10:14:49 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 is being set with open permissions: ugo+rw Nov 02 10:14:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:49 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 Nov 02 10:14:49 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:50 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686" returned: 0 in 0.294s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-8da52d51-7b46-43c9-8dfb-cdc23a768686" released by "_copy_volume_from_snapshot" :: held 11.321s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-6f26c68c-c9d6-465e-90dc-25216cd309f0-8da52d51-7b46-43c9-8dfb-cdc23a768686" released by "_create_volume_from_snapshot" :: held 11.407s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.436s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.005s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Creating offline snapshot 9415762e-675d-417a-9203-ad23e30c2868 of volume 4a966fa4-41d3-4e1f-b4f7-9fca5291159d {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eea3a92-a62a-4fb1-a0c2-9921efe7a993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da52d51-7b46-43c9-8dfb-cdc23a768686', 'volume_size': 1, 'snapshot_id': '6f26c68c-c9d6-465e-90dc-25216cd309f0'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f366d96-8e8c-4c71-b7fa-0b13fadb4203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c9d143-2518-4458-9980-535a5160a54e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:50 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Volume volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 (8da52d51-7b46-43c9-8dfb-cdc23a768686): created successfully Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f366d96-8e8c-4c71-b7fa-0b13fadb4203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Flow 'volume_create_manager' (32c55377-50d0-4409-bd67-4fad208a9e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:14:50 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8f18f95e-fc7b-4530-9700-c9071df15f04 tempest-TestStampPattern-274963852 None] Created volume successfully. Nov 02 10:14:50 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d Nov 02 10:14:50 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:50 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" returned: 0 in 0.537s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:50 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 1G Nov 02 10:14:50 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:51 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 1G" returned: 0 in 0.587s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:51 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 Nov 02 10:14:51 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:51 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868" returned: 0 in 0.451s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:51 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:14:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:52 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 Nov 02 10:14:52 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868" returned: 0 in 0.380s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:52 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.info Nov 02 10:14:52 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:52 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.info" returned: 0 in 0.454s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:52 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:14:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:52 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.info Nov 02 10:14:52 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:53 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.info" returned: 0 in 0.288s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:14:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:14:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Creating offline snapshot b0c7328a-1ecf-4425-b1aa-91d3c4857163 of volume 57098713-c2d4-48b5-9207-b32785423144 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:14:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f5867e-515b-4808-a54a-c580d9f6562b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:53 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 Nov 02 10:14:53 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:53 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144" returned: 0 in 0.566s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:53 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 1G Nov 02 10:14:53 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:54 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 1G" returned: 0 in 0.756s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57098713-c2d4-48b5-9207-b32785423144 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:54 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57098713-c2d4-48b5-9207-b32785423144 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 Nov 02 10:14:54 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:54 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57098713-c2d4-48b5-9207-b32785423144 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163" returned: 0 in 0.346s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:54 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:14:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:54 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 Nov 02 10:14:54 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:55 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163" returned: 0 in 0.264s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:55 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.info Nov 02 10:14:55 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:55 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.info" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:55 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:14:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:55 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.info Nov 02 10:14:55 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:56 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.info" returned: 0 in 0.572s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:14:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ccbdb4d8-b10f-4a0d-9f6a-bd62eaff2bb4 tempest-GroupSnapshotsTest-1888253042 None] group_snapshot 7d30dad0-ccac-490f-873e-a2f93edd95a9: created successfully Nov 02 10:14:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] group_snapshot 7d30dad0-ccac-490f-873e-a2f93edd95a9: deleting Nov 02 10:14:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] group_snapshot 7d30dad0-ccac-490f-873e-a2f93edd95a9: deleting {{(pid=86840) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:14:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-9415762e-675d-417a-9203-ad23e30c2868" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-9415762e-675d-417a-9203-ad23e30c2868" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Deleting offline snapshot 9415762e-675d-417a-9203-ad23e30c2868 of volume 4a966fa4-41d3-4e1f-b4f7-9fca5291159d {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:14:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] snapshot_file for this snap is: volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:14:57 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df97149-14c5-4b79-90a9-fcbaab80a0dd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:57 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 Nov 02 10:14:57 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:57 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868" returned: 0 in 0.598s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:57 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe5884-4341-4e41-a7af-920e8b2b1b1e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:57 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d Nov 02 10:14:57 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:58 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" returned: 0 in 0.503s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:58 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 Nov 02 10:14:58 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:58 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868" returned: 0 in 0.454s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:58 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868 Nov 02 10:14:58 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:59 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d.9415762e-675d-417a-9203-ad23e30c2868" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-9415762e-675d-417a-9203-ad23e30c2868" released by "_delete_snapshot" :: held 2.137s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" released by "delete_snapshot" :: held 2.176s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-57098713-c2d4-48b5-9207-b32785423144" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-57098713-c2d4-48b5-9207-b32785423144" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-b0c7328a-1ecf-4425-b1aa-91d3c4857163" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-b0c7328a-1ecf-4425-b1aa-91d3c4857163" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Deleting offline snapshot b0c7328a-1ecf-4425-b1aa-91d3c4857163 of volume 57098713-c2d4-48b5-9207-b32785423144 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] snapshot_file for this snap is: volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a36432d-5fca-4eea-98fc-1bdd8291da81]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:14:59 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 Nov 02 10:14:59 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:14:59 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163" returned: 0 in 0.564s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57098713-c2d4-48b5-9207-b32785423144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[21167b04-67da-4dbd-860f-282e23281865]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:14:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:00 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 Nov 02 10:15:00 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:00 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144" returned: 0 in 0.566s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:00 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 Nov 02 10:15:00 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:01 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163" returned: 0 in 0.510s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:01 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163 Nov 02 10:15:01 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:01 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144.b0c7328a-1ecf-4425-b1aa-91d3c4857163" returned: 0 in 0.339s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-b0c7328a-1ecf-4425-b1aa-91d3c4857163" released by "_delete_snapshot" :: held 2.182s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-57098713-c2d4-48b5-9207-b32785423144" released by "delete_snapshot" :: held 2.229s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:01 devstack cinder-volume[86840]: WARNING cinder.quota [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-469203761 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-469203761, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:15:01 devstack cinder-volume[86840]: WARNING cinder.quota [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-469203761 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-469203761, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:15:01 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['0d8dedcc-5a59-43d9-81cb-7c6d76052ae9', '3fde9858-95f1-434d-bd94-23f456d8bd7d', '72384bad-2ff0-46c5-9939-3204a1e4539d', '2b1b5e5f-d662-4884-a49e-ca23f730ed8d'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:01 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['e5dcb580-4a7c-46d2-9da8-bfe430028bdd', '3a995e91-facf-40e2-9f81-0240586adb48', '1e9aa23a-38f5-46e8-91f9-60b99867968c', 'b4a0cddd-7d64-4c98-9185-11bad3fd9822'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:01 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a91969c1-95d8-42b0-a1a9-01217383877e tempest-GroupSnapshotsTest-1888253042 None] group_snapshot 7d30dad0-ccac-490f-873e-a2f93edd95a9: deleted successfully Nov 02 10:15:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" acquired by "delete_volume" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:03 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfed826-8428-41b7-9b4f-d4715b25d101]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:03 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d Nov 02 10:15:03 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:03 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" returned: 0 in 0.449s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:03 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d Nov 02 10:15:03 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" returned: 0 in 0.296s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-4a966fa4-41d3-4e1f-b4f7-9fca5291159d" released by "delete_volume" :: held 0.869s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-57098713-c2d4-48b5-9207-b32785423144" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-57098713-c2d4-48b5-9207-b32785423144" acquired by "delete_volume" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[43947a72-4e50-486b-b2e3-cd085f873c01]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 Nov 02 10:15:04 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:04 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144" returned: 0 in 0.519s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:04 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144 Nov 02 10:15:04 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:05 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-57098713-c2d4-48b5-9207-b32785423144" returned: 0 in 0.309s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-57098713-c2d4-48b5-9207-b32785423144" released by "delete_volume" :: held 0.986s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['abfdf8fc-62b4-41bd-ab19-64a5fbeaf469'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:05 devstack cinder-volume[86840]: WARNING cinder.quota [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-469203761 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-469203761, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['927efa16-d116-4e19-88e1-208d7188eb80', 'ca51dc9e-804a-4913-b57a-a17984b554ad', '64e1ec94-d04f-476f-8775-13edf5b68809', 'fc79611e-2323-4068-8a78-439d6f561548'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['c1b04c2e-d34e-4321-affa-ef532f6442da', '5693645d-9d47-46d1-9b3b-b86e292aa968', 'ea2d7125-5f17-4843-b7b4-56da2a2622ed', '1e1eecfc-9d99-4257-8c7c-5811a74c3f60'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:05 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:15:05 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:06 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.468s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cfecfe53-81a6-44fa-ad15-0cd17623c849 tempest-GroupSnapshotsTest-1888253042 None] Delete group completed successfully. Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Flow 'volume_create_manager' (f6411227-b76f-4084-9037-a44b96c7bac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b6bb8f-2c89-4a9e-8158-12861a5c874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b6bb8f-2c89-4a9e-8158-12861a5c874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-920988653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b84274-0bd6-467e-a1ae-5b6b1e866f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07dd9dbd058540b7bd8a10c6a947dbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:06Z,use_quota=True,user_id='7dfc170a96f1470d84a8e824b894169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618fd922-928f-4500-bd0b-430e966eae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618fd922-928f-4500-bd0b-430e966eae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b54e597-3d82-439a-aaa2-5e26588a69a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b54e597-3d82-439a-aaa2-5e26588a69a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b84274-0bd6-467e-a1ae-5b6b1e866f30', 'volume_name': 'volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05856263-bb0e-4149-b72d-6f2295607083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05856263-bb0e-4149-b72d-6f2295607083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a476eed2-6595-4e0b-ae38-5ded9c8933b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:06 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Volume 52b84274-0bd6-467e-a1ae-5b6b1e866f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30', 'volume_size': 1} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-920988653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b84274-0bd6-467e-a1ae-5b6b1e866f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07dd9dbd058540b7bd8a10c6a947dbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:06Z,use_quota=True,user_id='7dfc170a96f1470d84a8e824b894169a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Creating volume 52b84274-0bd6-467e-a1ae-5b6b1e866f30 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:06 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:06 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 1073741824 Nov 02 10:15:06 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ae247e1e-b820-4236-af05-7d92dc8ba52c tempest-GroupSnapshotsTest-1888253042 None] Group tempest-GroupSnapshotsTest-Group-1718031709: creating Nov 02 10:15:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ae247e1e-b820-4236-af05-7d92dc8ba52c tempest-GroupSnapshotsTest-1888253042 None] Group tempest-GroupSnapshotsTest-Group-1718031709: created successfully Nov 02 10:15:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ae247e1e-b820-4236-af05-7d92dc8ba52c tempest-GroupSnapshotsTest-1888253042 None] Create group completed successfully. Nov 02 10:15:06 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 1073741824" returned: 0 in 0.457s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:07 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 Nov 02 10:15:07 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:07 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30" returned: 0 in 0.250s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a476eed2-6595-4e0b-ae38-5ded9c8933b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d797ac1-7634-4ff0-a828-d86d947d9dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Volume volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 (52b84274-0bd6-467e-a1ae-5b6b1e866f30): created successfully Nov 02 10:15:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d797ac1-7634-4ff0-a828-d86d947d9dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Flow 'volume_create_manager' (f6411227-b76f-4084-9037-a44b96c7bac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f1a41551-d12c-4dab-8fb1-d97690b09c48 tempest-TestImageHashVerification-1691829030 None] Created volume successfully. Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Flow 'volume_create_manager' (44b889f4-fa80-4a67-9cb2-088d930719c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b942c769-d2fc-4c98-a40e-bbb15d137ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b942c769-d2fc-4c98-a40e-bbb15d137ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916329586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57a92bb0-4415-4dc0-892f-95989b814fb9,host='devstack@QuobyteHD#QuobyteHD',id=8d097e74-79fe-4298-bca7-a18e1e56b21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc35b64c2e4c496a9eef008d98030bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:08Z,use_quota=True,user_id='11421927a5b64acda6ee9d6c6d85f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d56c9f33-40c8-4b07-b974-e1d7541c5f2e),volume_type_id=d56c9f33-40c8-4b07-b974-e1d7541c5f2e)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154c0217-40e5-448f-a513-85d8f420b5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154c0217-40e5-448f-a513-85d8f420b5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e347e531-c85d-4159-b564-242eba044fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e347e531-c85d-4159-b564-242eba044fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d097e74-79fe-4298-bca7-a18e1e56b21e', 'volume_name': 'volume-8d097e74-79fe-4298-bca7-a18e1e56b21e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7283bc9-6004-4cfb-9f0c-b5b970b009a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7283bc9-6004-4cfb-9f0c-b5b970b009a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30519fbe-5b51-4e6e-957f-7f062b8da452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Volume 8d097e74-79fe-4298-bca7-a18e1e56b21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d097e74-79fe-4298-bca7-a18e1e56b21e', 'volume_size': 1} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57a92bb0-4415-4dc0-892f-95989b814fb9,created_at=2026-11-02T09:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916329586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57a92bb0-4415-4dc0-892f-95989b814fb9,host='devstack@QuobyteHD#QuobyteHD',id=8d097e74-79fe-4298-bca7-a18e1e56b21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc35b64c2e4c496a9eef008d98030bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:08Z,use_quota=True,user_id='11421927a5b64acda6ee9d6c6d85f785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d56c9f33-40c8-4b07-b974-e1d7541c5f2e),volume_type_id=d56c9f33-40c8-4b07-b974-e1d7541c5f2e)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Creating volume 8d097e74-79fe-4298-bca7-a18e1e56b21e {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:08 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:08 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e 1073741824 Nov 02 10:15:08 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:08 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e 1073741824" returned: 0 in 0.478s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:08 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e Nov 02 10:15:08 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:09 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e" returned: 0 in 0.285s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30519fbe-5b51-4e6e-957f-7f062b8da452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d097e74-79fe-4298-bca7-a18e1e56b21e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bae5d3-9400-46d0-a8fb-ea581b62fb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:09 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Volume volume-8d097e74-79fe-4298-bca7-a18e1e56b21e (8d097e74-79fe-4298-bca7-a18e1e56b21e): created successfully Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bae5d3-9400-46d0-a8fb-ea581b62fb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Flow 'volume_create_manager' (44b889f4-fa80-4a67-9cb2-088d930719c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c77a875a-7ed9-4c44-b678-0e1f196e0e1d tempest-GroupSnapshotsTest-1888253042 None] Created volume successfully. Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee296ea-82f8-440b-9430-117e513910d6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:09 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 Nov 02 10:15:09 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] GroupSnapshot a75a8cb6-1abc-4ee9-bf48-c7796f4ccf7e: creating. Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Group snapshot a75a8cb6-1abc-4ee9-bf48-c7796f4ccf7e: creating. {{(pid=86840) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:09 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30" returned: 0 in 0.416s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6418e1d-afc1-4509-86b0-eb456730b91d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:10 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 Nov 02 10:15:10 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:10 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30" returned: 0 in 0.389s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 /opt/stack/data/cinder/conversion/52b84274-0bd6-467e-a1ae-5b6b1e866f30.temp_image.42258ae9-78a0-4541-b37a-6fda1279b816j9tmmqi1.img {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:10 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 /opt/stack/data/cinder/conversion/52b84274-0bd6-467e-a1ae-5b6b1e866f30.temp_image.42258ae9-78a0-4541-b37a-6fda1279b816j9tmmqi1.img Nov 02 10:15:10 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:15 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 /opt/stack/data/cinder/conversion/52b84274-0bd6-467e-a1ae-5b6b1e866f30.temp_image.42258ae9-78a0-4541-b37a-6fda1279b816j9tmmqi1.img" returned: 0 in 5.602s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:15 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e871a2de-10ef-4f67-a04a-e38c51d4680e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:16 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 Nov 02 10:15:16 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:16 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30" returned: 0 in 0.528s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:16 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/conversion/52b84274-0bd6-467e-a1ae-5b6b1e866f30.temp_image.42258ae9-78a0-4541-b37a-6fda1279b816j9tmmqi1.img {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:15:16 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Converted 1024.00 MB image at 182.76 MB/s Nov 02 10:15:16 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] 42258ae9-78a0-4541-b37a-6fda1279b816 was raw, no need to convert to raw {{(pid=86840) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:15:19 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:INSERT=10,cinder:SELECT=38,cinder:UPDATE=44,cinder:DELETE=3 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:15:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:15:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:20 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:15:20 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:21 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.342s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:15:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:15:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:15:26 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=45,cinder:UPDATE=44,cinder:INSERT=12 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:15:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.550s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:36 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Uploaded volume to glance image-id: 42258ae9-78a0-4541-b37a-6fda1279b816. {{(pid=86840) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:15:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 26.187s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Creating offline snapshot f8fb3c2f-f9a1-4437-90d0-b969414c74ff of volume 8d097e74-79fe-4298-bca7-a18e1e56b21e {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:15:36 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-47bf1709-3520-48de-aae3-1b84d85835f5 tempest-TestImageHashVerification-1691829030 None] Copy volume to image completed successfully. Nov 02 10:15:36 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8f0b26-0595-404d-b223-e1c76f232a8e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:36 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e Nov 02 10:15:36 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:36 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e" returned: 0 in 0.501s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:36 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff 1G Nov 02 10:15:36 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-e60c751f-2017-48c6-b44c-64b9bf82976e req-90159b50-a95c-4fc5-9c0a-09a4c12dc71b tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:37 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff 1G" returned: 0 in 0.469s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d097e74-79fe-4298-bca7-a18e1e56b21e -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Acquiring lock "cinder-52b84274-0bd6-467e-a1ae-5b6b1e866f30-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:37 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d097e74-79fe-4298-bca7-a18e1e56b21e -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff Nov 02 10:15:37 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Lock "cinder-52b84274-0bd6-467e-a1ae-5b6b1e866f30-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Acquiring lock "cinder-quobyte-52b84274-0bd6-467e-a1ae-5b6b1e866f30" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Lock "cinder-quobyte-52b84274-0bd6-467e-a1ae-5b6b1e866f30" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[350dd39d-2759-4f51-888f-f5f21f86c325]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:37 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 Nov 02 10:15:37 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:37 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d097e74-79fe-4298-bca7-a18e1e56b21e -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff" returned: 0 in 0.350s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:37 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:37 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff Nov 02 10:15:37 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:37 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30" returned: 0 in 0.407s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:37 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30 Nov 02 10:15:37 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:37 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff" returned: 0 in 0.279s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:37 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.info Nov 02 10:15:37 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:37 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-52b84274-0bd6-467e-a1ae-5b6b1e866f30" returned: 0 in 0.266s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Lock "cinder-quobyte-52b84274-0bd6-467e-a1ae-5b6b1e866f30" released by "delete_volume" :: held 0.726s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Created reservations ['02061b83-730a-4ae8-b8fa-e562a6c75b8f', '41684deb-ee15-4ff9-ac83-e66482804383', '1f84aa9f-3aa7-4de2-b938-8ebc23a75b14', '188fc3ab-45a6-4f11-bb81-66d3a7f9f149'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:37 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.info" returned: 0 in 0.264s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:37 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:15:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:37 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.info Nov 02 10:15:37 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:38 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:15:38 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:38 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.info" returned: 0 in 0.269s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-e60c751f-2017-48c6-b44c-64b9bf82976e req-90159b50-a95c-4fc5-9c0a-09a4c12dc71b tempest-TestStampPattern-274963852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.585s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [req-e60c751f-2017-48c6-b44c-64b9bf82976e req-90159b50-a95c-4fc5-9c0a-09a4c12dc71b tempest-TestStampPattern-274963852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:38 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.288s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Deleted volume successfully. Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-e60c751f-2017-48c6-b44c-64b9bf82976e req-90159b50-a95c-4fc5-9c0a-09a4c12dc71b tempest-TestStampPattern-274963852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901', 'name': 'volume-8da52d51-7b46-43c9-8dfb-cdc23a768686', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1385b76-6eee-4358-9c7a-d5157d364895', 'enforce_multipath': True} {{(pid=86840) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:15:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7e40dc3c-ec40-4458-9b03-1681a3adac36 tempest-TestImageHashVerification-1691829030 None] Lock "cinder-52b84274-0bd6-467e-a1ae-5b6b1e866f30-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e294dda4-8685-43ba-81ba-0617aa086886 tempest-GroupSnapshotsTest-1888253042 None] group_snapshot a75a8cb6-1abc-4ee9-bf48-c7796f4ccf7e: created successfully Nov 02 10:15:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-e60c751f-2017-48c6-b44c-64b9bf82976e req-90159b50-a95c-4fc5-9c0a-09a4c12dc71b tempest-TestStampPattern-274963852 None] attachment_update completed successfully. Nov 02 10:15:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] group_snapshot a75a8cb6-1abc-4ee9-bf48-c7796f4ccf7e: deleting Nov 02 10:15:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] group_snapshot a75a8cb6-1abc-4ee9-bf48-c7796f4ccf7e: deleting {{(pid=86840) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:15:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-8d097e74-79fe-4298-bca7-a18e1e56b21e" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-8d097e74-79fe-4298-bca7-a18e1e56b21e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-f8fb3c2f-f9a1-4437-90d0-b969414c74ff" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-f8fb3c2f-f9a1-4437-90d0-b969414c74ff" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Deleting offline snapshot f8fb3c2f-f9a1-4437-90d0-b969414c74ff of volume 8d097e74-79fe-4298-bca7-a18e1e56b21e {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:15:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] snapshot_file for this snap is: volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:15:39 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefe5dd4-061d-46cd-b225-0085ab72c64d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:39 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff Nov 02 10:15:39 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:40 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff" returned: 0 in 0.432s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d097e74-79fe-4298-bca7-a18e1e56b21e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:40 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e140d-24e9-4c4d-b0eb-315ab8f0a201]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:40 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e Nov 02 10:15:40 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:40 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e" returned: 0 in 0.434s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:40 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff Nov 02 10:15:40 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:41 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff" returned: 0 in 0.484s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:41 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff Nov 02 10:15:41 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:41 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e.f8fb3c2f-f9a1-4437-90d0-b969414c74ff" returned: 0 in 0.332s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:41 devstack cinder-volume[86840]: INFO cinder.volume.manager [req-d5005d50-2aec-46a9-bc60-0c8928fae7e5 req-8b2a7993-c715-4e13-8832-f5123b717e48 tempest-TestStampPattern-274963852 None] Terminate volume connection completed successfully. Nov 02 10:15:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [req-d5005d50-2aec-46a9-bc60-0c8928fae7e5 req-8b2a7993-c715-4e13-8832-f5123b717e48 tempest-TestStampPattern-274963852 None] Deleting attachment b1385b76-6eee-4358-9c7a-d5157d364895. {{(pid=86840) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:15:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-f8fb3c2f-f9a1-4437-90d0-b969414c74ff" released by "_delete_snapshot" :: held 1.857s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-8d097e74-79fe-4298-bca7-a18e1e56b21e" released by "delete_snapshot" :: held 1.888s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:41 devstack cinder-volume[86840]: WARNING cinder.quota [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1860475904 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1860475904, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:15:41 devstack cinder-volume[86840]: WARNING cinder.quota [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1860475904 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1860475904, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:15:41 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['7cf24404-de2f-4840-a0b4-a9c11838bc7f', '0ab40a78-f5b3-4d88-a6d1-f9286c0e15e1', 'a00706e3-3aa4-41f9-be13-bf6fba1073df', '0cd136bc-0542-459d-a729-59e7b73afa8b'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:41 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-030ebb05-fb61-47c0-b142-06fd4e1fa4a0 tempest-GroupSnapshotsTest-1888253042 None] group_snapshot a75a8cb6-1abc-4ee9-bf48-c7796f4ccf7e: deleted successfully Nov 02 10:15:42 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "cinder-quobyte-8d097e74-79fe-4298-bca7-a18e1e56b21e" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:42 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-8d097e74-79fe-4298-bca7-a18e1e56b21e" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:42 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e81270d-f758-4319-b3a4-127906aa1a53]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:42 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e Nov 02 10:15:42 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:42 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e" returned: 0 in 0.480s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:42 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e Nov 02 10:15:42 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:43 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8d097e74-79fe-4298-bca7-a18e1e56b21e" returned: 0 in 0.332s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Lock "cinder-quobyte-8d097e74-79fe-4298-bca7-a18e1e56b21e" released by "delete_volume" :: held 0.921s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['ad51425a-744b-4bc1-9169-0cc155693059'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:43 devstack cinder-volume[86840]: WARNING cinder.quota [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1860475904 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1860475904, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Created reservations ['2709e2ae-c98c-4d27-8182-39fd6c3f5227', 'a3be8538-42a7-4c79-99fc-b7bcbcdcd559', 'b3f7f65f-e4a4-4f28-8f86-33c362b1de3b', 'ac726135-83e9-488a-ba3f-bd6cd1629b0a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:43 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:15:43 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:43 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.409s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:43 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:43 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8ede80ad-e271-4c9d-8a82-1ea4d9c743fb tempest-GroupSnapshotsTest-1888253042 None] Delete group completed successfully. Nov 02 10:15:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Acquiring lock "cinder-8da52d51-7b46-43c9-8dfb-cdc23a768686-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Lock "cinder-8da52d51-7b46-43c9-8dfb-cdc23a768686-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Acquiring lock "cinder-quobyte-8da52d51-7b46-43c9-8dfb-cdc23a768686" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-8da52d51-7b46-43c9-8dfb-cdc23a768686" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:46 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[31675db4-64f7-4405-a726-8c0a2c93deb7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:46 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 Nov 02 10:15:46 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:46 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686" returned: 0 in 0.413s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:46 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686 Nov 02 10:15:46 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:47 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8da52d51-7b46-43c9-8dfb-cdc23a768686" returned: 0 in 0.324s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-8da52d51-7b46-43c9-8dfb-cdc23a768686" released by "delete_volume" :: held 0.813s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Created reservations ['68d958a3-1e20-41d0-8a3d-fc38d5559840', 'c5acab2b-bf2d-471d-b049-2b17a2508600', '2fab8c0f-2ad2-4368-b9c1-ea31c41aa6ed', '79e8cbbe-845f-4351-939a-7c200ccff90a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:47 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:15:47 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Acquiring lock "cinder-6f26c68c-c9d6-465e-90dc-25216cd309f0-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Lock "cinder-6f26c68c-c9d6-465e-90dc-25216cd309f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Acquiring lock "cinder-quobyte-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:47 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.408s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Acquiring lock "cinder-quobyte-6f26c68c-c9d6-465e-90dc-25216cd309f0" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Deleted volume successfully. Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-6f26c68c-c9d6-465e-90dc-25216cd309f0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Deleting offline snapshot 6f26c68c-c9d6-465e-90dc-25216cd309f0 of volume 75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] snapshot_file for this snap is: volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5a921ecf-5187-47b9-a57d-33223aa62d95 tempest-TestStampPattern-274963852 None] Lock "cinder-8da52d51-7b46-43c9-8dfb-cdc23a768686-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f5886-6d7b-4938-bf13-a88357a73a21]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:48 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 Nov 02 10:15:48 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:48 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0" returned: 0 in 0.387s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:15:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d406a968-a83b-4cb7-b723-e49a3390ef96]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:48 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 Nov 02 10:15:48 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:48 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" returned: 0 in 0.636s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:49 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 Nov 02 10:15:49 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:49 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0" returned: 0 in 0.392s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:49 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0 Nov 02 10:15:49 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:49 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0.6f26c68c-c9d6-465e-90dc-25216cd309f0" returned: 0 in 0.252s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-6f26c68c-c9d6-465e-90dc-25216cd309f0" released by "_delete_snapshot" :: held 1.839s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" released by "delete_snapshot" :: held 1.893s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:49 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Created reservations ['559f1f87-f561-4361-a8f4-eb0e41fc510a', '65a4fc98-a253-4f23-a39f-9ec13133b50f', '1a773468-d0b2-47f8-b39d-7e3ecff5d0f0', '05645a90-63c7-4827-8487-48b438028698'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Delete snapshot completed successfully. Nov 02 10:15:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a0ea8df0-1981-4ba2-a3c1-485d26c2e09b tempest-TestStampPattern-274963852 None] Lock "cinder-6f26c68c-c9d6-465e-90dc-25216cd309f0-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Acquiring lock "cinder-75329959-b6f3-4144-9a5e-eb00b9fe5cb0-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Lock "cinder-75329959-b6f3-4144-9a5e-eb00b9fe5cb0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Acquiring lock "cinder-quobyte-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:15:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:15:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefe5876-d3b3-4296-b7b8-25314b374557]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:15:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:54 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 Nov 02 10:15:54 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:54 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" returned: 0 in 0.430s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:54 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0 Nov 02 10:15:54 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:54 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (2c448386-34c4-4c38-981e-ae77636e88fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a07316-53de-43e9-854f-1fae80626d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a07316-53de-43e9-854f-1fae80626d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699371733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a792f9c9-3696-46a8-9cd9-698fac60d8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:55Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0764cf36-53f9-41ce-87c5-bb78f032c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0764cf36-53f9-41ce-87c5-bb78f032c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fb977e-dec5-445e-971d-3ab2cd9b67df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fb977e-dec5-445e-971d-3ab2cd9b67df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a792f9c9-3696-46a8-9cd9-698fac60d8a5', 'volume_name': 'volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b6289e-ffe6-4e30-aa72-f5779603967e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b6289e-ffe6-4e30-aa72-f5779603967e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3639c5d-32af-44c9-9154-5947edb373e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:55 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume a792f9c9-3696-46a8-9cd9-698fac60d8a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5', 'volume_size': 1} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699371733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a792f9c9-3696-46a8-9cd9-698fac60d8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:55Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Creating volume a792f9c9-3696-46a8-9cd9-698fac60d8a5 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:55 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:55 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 1073741824 Nov 02 10:15:55 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:55 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" returned: 0 in 0.300s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Lock "cinder-quobyte-75329959-b6f3-4144-9a5e-eb00b9fe5cb0" released by "delete_volume" :: held 0.812s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Created reservations ['3a70156d-eef9-40fb-8a4c-12757e4472d5', '09bace5d-cfdc-4977-a1d3-7b9ebcf99906', '2f1a28c6-5365-43b7-a5df-2d3ed78e48e4', 'e8d05106-582c-4b66-9243-24ff23046528'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:55 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:15:55 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:55 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 1073741824" returned: 0 in 0.582s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:55 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 Nov 02 10:15:55 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:55 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.383s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:15:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Deleted volume successfully. Nov 02 10:15:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fe646be3-1b75-40b1-af36-ed861f1b37f9 tempest-TestStampPattern-274963852 None] Lock "cinder-75329959-b6f3-4144-9a5e-eb00b9fe5cb0-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:15:56 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5" returned: 0 in 0.392s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3639c5d-32af-44c9-9154-5947edb373e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a69bd1d-16fa-4862-93eb-4a891d9f9aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:56 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 (a792f9c9-3696-46a8-9cd9-698fac60d8a5): created successfully Nov 02 10:15:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a69bd1d-16fa-4862-93eb-4a891d9f9aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (2c448386-34c4-4c38-981e-ae77636e88fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5f0c7e84-0858-4d7c-8ba7-b3076ae4a4c6 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created volume successfully. Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (3561b5cc-4726-4257-adcb-c464201e3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72c2d39-cc01-4c1a-b61e-be8c9a4ae103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72c2d39-cc01-4c1a-b61e-be8c9a4ae103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-600969381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b391d7a4-208c-4d01-8241-327f84f8b4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:58Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce24e5f-51bd-4ed9-b188-a1d00dd51de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce24e5f-51bd-4ed9-b188-a1d00dd51de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6070200b-a4bd-4755-8bce-c3a4e78b74d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6070200b-a4bd-4755-8bce-c3a4e78b74d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b391d7a4-208c-4d01-8241-327f84f8b4ca', 'volume_name': 'volume-b391d7a4-208c-4d01-8241-327f84f8b4ca', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03c43f5-4f7a-496d-b319-4ab3d572e0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03c43f5-4f7a-496d-b319-4ab3d572e0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1d9a2c-d006-43eb-ba51-bc12fd8fc95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:57 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume b391d7a4-208c-4d01-8241-327f84f8b4ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b391d7a4-208c-4d01-8241-327f84f8b4ca', 'volume_size': 1} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-600969381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b391d7a4-208c-4d01-8241-327f84f8b4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:58Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Creating volume b391d7a4-208c-4d01-8241-327f84f8b4ca {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:57 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:15:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:57 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca 1073741824 Nov 02 10:15:57 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (64db0587-1d74-4125-a271-be0681f86221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c4e3ae-0129-4c0e-aca7-93e59c18c4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c4e3ae-0129-4c0e-aca7-93e59c18c4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1651719586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da728cd3-09fe-4079-858e-284104b18e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:58Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1fc93b-9086-4648-8138-c64e2fffbd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1fc93b-9086-4648-8138-c64e2fffbd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db9779a-5eb9-4f63-bdc7-c3f089871acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db9779a-5eb9-4f63-bdc7-c3f089871acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da728cd3-09fe-4079-858e-284104b18e0e', 'volume_name': 'volume-da728cd3-09fe-4079-858e-284104b18e0e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7afb1d-84a7-43df-a3df-dcbdcbc996b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7afb1d-84a7-43df-a3df-dcbdcbc996b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4761aedf-733d-4f4a-97f4-b91221777ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume da728cd3-09fe-4079-858e-284104b18e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da728cd3-09fe-4079-858e-284104b18e0e', 'volume_size': 1} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:58 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca 1073741824" returned: 0 in 0.674s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:58 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca Nov 02 10:15:58 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (7e1dd4b2-fade-4c19-823d-78fc4eabb259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee9c74a-908e-4bcf-93f4-df0183196a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee9c74a-908e-4bcf-93f4-df0183196a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577383101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e56e85-6510-423e-8292-45502e8ccbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:59Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5815264-8a88-4a9c-995c-1d09289160a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5815264-8a88-4a9c-995c-1d09289160a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb375c7-120c-454f-9f28-177fd1fc9563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb375c7-120c-454f-9f28-177fd1fc9563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e56e85-6510-423e-8292-45502e8ccbc8', 'volume_name': 'volume-85e56e85-6510-423e-8292-45502e8ccbc8', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad844f8f-f36e-480f-9b49-675d8fe232a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad844f8f-f36e-480f-9b49-675d8fe232a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0db87ec-160a-445e-aef8-cc9176a5fedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:58 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume 85e56e85-6510-423e-8292-45502e8ccbc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e56e85-6510-423e-8292-45502e8ccbc8', 'volume_size': 1} Nov 02 10:15:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:59 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca" returned: 0 in 0.460s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1651719586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da728cd3-09fe-4079-858e-284104b18e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:58Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Creating volume da728cd3-09fe-4079-858e-284104b18e0e {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:15:59 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1d9a2c-d006-43eb-ba51-bc12fd8fc95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b391d7a4-208c-4d01-8241-327f84f8b4ca', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7645ad0a-b996-4262-8874-cbc14ef8c2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:59 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e 1073741824 Nov 02 10:15:59 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume volume-b391d7a4-208c-4d01-8241-327f84f8b4ca (b391d7a4-208c-4d01-8241-327f84f8b4ca): created successfully Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7645ad0a-b996-4262-8874-cbc14ef8c2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (3561b5cc-4726-4257-adcb-c464201e3313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3f7752c3-b55b-4203-a5c3-3d9a140e0cf7 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created volume successfully. Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (c029757a-3f06-467a-a179-8a306ac3a218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e2362c-298e-4354-8ec9-1665d1b184fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e2362c-298e-4354-8ec9-1665d1b184fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026680560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4937835d-cc61-4409-a105-dfe1e5472abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:59Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e891743-4bf4-4e05-85fd-b711395a54df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e891743-4bf4-4e05-85fd-b711395a54df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e39657f-e054-43c1-b8ed-c05b05e76133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e39657f-e054-43c1-b8ed-c05b05e76133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4937835d-cc61-4409-a105-dfe1e5472abb', 'volume_name': 'volume-4937835d-cc61-4409-a105-dfe1e5472abb', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13de75a-a21c-4a48-8948-9b3a15495765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13de75a-a21c-4a48-8948-9b3a15495765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19148f99-e6ea-480c-a017-6b3a13f66dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:15:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume 4937835d-cc61-4409-a105-dfe1e5472abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4937835d-cc61-4409-a105-dfe1e5472abb', 'volume_size': 1} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:15:59 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e 1073741824" returned: 0 in 0.772s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:15:59 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e Nov 02 10:15:59 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:15:59 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (575e402b-ed93-4f28-919c-a87a5186b531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e0ea01-b112-4baf-a56f-18c9966eec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e0ea01-b112-4baf-a56f-18c9966eec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474232006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe642c61-2b20-47b5-aa10-eb5e12c6ca68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:00Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47d6269-e6c8-42b9-86e1-f4d4d90a53cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47d6269-e6c8-42b9-86e1-f4d4d90a53cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a49a82e-5a63-4804-9fcf-a883427debaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a49a82e-5a63-4804-9fcf-a883427debaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe642c61-2b20-47b5-aa10-eb5e12c6ca68', 'volume_name': 'volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724c9566-2156-4563-936b-3dc335b29cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724c9566-2156-4563-936b-3dc335b29cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cab51c-8c62-485f-9fa5-7230268a78ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:00 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume fe642c61-2b20-47b5-aa10-eb5e12c6ca68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68', 'volume_size': 1} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:00 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e" returned: 0 in 0.267s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.196s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577383101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e56e85-6510-423e-8292-45502e8ccbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:59Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Creating volume 85e56e85-6510-423e-8292-45502e8ccbc8 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:00 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4761aedf-733d-4f4a-97f4-b91221777ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da728cd3-09fe-4079-858e-284104b18e0e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:00 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8 1073741824 Nov 02 10:16:00 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7256e056-b924-4d1b-80ee-f4787ac344a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:00 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume volume-da728cd3-09fe-4079-858e-284104b18e0e (da728cd3-09fe-4079-858e-284104b18e0e): created successfully Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7256e056-b924-4d1b-80ee-f4787ac344a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (64db0587-1d74-4125-a271-be0681f86221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-089df962-3f31-46a6-beeb-39316d6e511e tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created volume successfully. Nov 02 10:16:00 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8 1073741824" returned: 0 in 0.491s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:00 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8 Nov 02 10:16:00 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:01 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8" returned: 0 in 0.384s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.647s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026680560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4937835d-cc61-4409-a105-dfe1e5472abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:59Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Creating volume 4937835d-cc61-4409-a105-dfe1e5472abb {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:01 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:01 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb 1073741824 Nov 02 10:16:01 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0db87ec-160a-445e-aef8-cc9176a5fedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e56e85-6510-423e-8292-45502e8ccbc8', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7bdcc0-f383-4fcb-a413-8944f770b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Flow 'volume_create_manager' (bc9e1e55-24c9-4c42-95ab-b94c4e8da42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a96415-6cb8-4d9b-85dc-61754ece5503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:01 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume volume-85e56e85-6510-423e-8292-45502e8ccbc8 (85e56e85-6510-423e-8292-45502e8ccbc8): created successfully Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7bdcc0-f383-4fcb-a413-8944f770b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (7e1dd4b2-fade-4c19-823d-78fc4eabb259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a96415-6cb8-4d9b-85dc-61754ece5503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1737097902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eaca1f-dba9-400d-9086-c311a17a519f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6747b7664704d36af983974eda217df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:01Z,use_quota=True,user_id='9ae4ee8acd214a799f1f80a16edb5296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd94047-1b43-4b93-a020-9a2b012658ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd94047-1b43-4b93-a020-9a2b012658ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b5d7c8-b660-4017-8e89-dd41dca31d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b5d7c8-b660-4017-8e89-dd41dca31d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4eaca1f-dba9-400d-9086-c311a17a519f', 'volume_name': 'volume-f4eaca1f-dba9-400d-9086-c311a17a519f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f9b7c3-53d6-4807-af5f-752944268e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f9b7c3-53d6-4807-af5f-752944268e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8d0064-373e-44cf-846b-d87f6c2c90e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:01 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Volume f4eaca1f-dba9-400d-9086-c311a17a519f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4eaca1f-dba9-400d-9086-c311a17a519f', 'volume_size': 1} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:01 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-28bf942f-89fc-47ff-b586-a5287c859061 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created volume successfully. Nov 02 10:16:01 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb 1073741824" returned: 0 in 0.511s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:01 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb Nov 02 10:16:01 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:02 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb" returned: 0 in 0.289s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.954s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474232006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe642c61-2b20-47b5-aa10-eb5e12c6ca68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f058150296a3478cbdba310d24e35d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:00Z,use_quota=True,user_id='8c74c7925d314554afb78de864c73d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Creating volume fe642c61-2b20-47b5-aa10-eb5e12c6ca68 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:02 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19148f99-e6ea-480c-a017-6b3a13f66dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4937835d-cc61-4409-a105-dfe1e5472abb', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:02 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 1073741824 Nov 02 10:16:02 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437ecb4a-adf6-4432-96ab-1e0263e0b61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume volume-4937835d-cc61-4409-a105-dfe1e5472abb (4937835d-cc61-4409-a105-dfe1e5472abb): created successfully Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437ecb4a-adf6-4432-96ab-1e0263e0b61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (c029757a-3f06-467a-a179-8a306ac3a218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ede32fbc-9ca4-44bd-92fa-bc835a18a820 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created volume successfully. Nov 02 10:16:02 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 1073741824" returned: 0 in 0.556s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:02 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 Nov 02 10:16:02 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:02 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68" returned: 0 in 0.274s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1737097902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eaca1f-dba9-400d-9086-c311a17a519f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6747b7664704d36af983974eda217df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:01Z,use_quota=True,user_id='9ae4ee8acd214a799f1f80a16edb5296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Creating volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:02 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cab51c-8c62-485f-9fa5-7230268a78ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:02 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f 1073741824 Nov 02 10:16:02 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1158f538-cd91-4935-b080-a593339c28af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Volume volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 (fe642c61-2b20-47b5-aa10-eb5e12c6ca68): created successfully Nov 02 10:16:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1158f538-cd91-4935-b080-a593339c28af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Flow 'volume_create_manager' (575e402b-ed93-4f28-919c-a87a5186b531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2bc62304-cc83-44f6-9abd-7de25763aada tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created volume successfully. Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-fe642c61-2b20-47b5-aa10-eb5e12c6ca68-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-fe642c61-2b20-47b5-aa10-eb5e12c6ca68-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-quobyte-fe642c61-2b20-47b5-aa10-eb5e12c6ca68" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-fe642c61-2b20-47b5-aa10-eb5e12c6ca68" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:03 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f 1073741824" returned: 0 in 0.553s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcccfbd-f07b-4d38-926b-3569eb94ebc5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:03 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f Nov 02 10:16:03 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:03 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 Nov 02 10:16:03 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:03 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f" returned: 0 in 0.248s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8d0064-373e-44cf-846b-d87f6c2c90e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4eaca1f-dba9-400d-9086-c311a17a519f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca1dc2a-860a-4e0c-a4f6-72653b19faa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:03 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Volume volume-f4eaca1f-dba9-400d-9086-c311a17a519f (f4eaca1f-dba9-400d-9086-c311a17a519f): created successfully Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca1dc2a-860a-4e0c-a4f6-72653b19faa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Flow 'volume_create_manager' (bc9e1e55-24c9-4c42-95ab-b94c4e8da42d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-673bf7f6-2811-495f-b9e8-f14dc6bbbbeb tempest-SnapshotsActionsTest-1196977088 None] Created volume successfully. Nov 02 10:16:03 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68" returned: 0 in 0.376s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:03 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68 Nov 02 10:16:03 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:04 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fe642c61-2b20-47b5-aa10-eb5e12c6ca68" returned: 0 in 0.282s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-fe642c61-2b20-47b5-aa10-eb5e12c6ca68" released by "delete_volume" :: held 0.714s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created reservations ['45ead696-22f7-4015-83de-6b473131c909', '0d558f00-d9d4-4533-bd30-c09be97881bc', '2da0f87c-744c-4a2e-b726-f0d16b7f7738', 'e150eac6-4864-4c00-8714-fef227b6c970'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:04 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:04 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-4937835d-cc61-4409-a105-dfe1e5472abb-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Creating offline snapshot 054a9892-2a46-4794-9cea-2fde5c767367 of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-4937835d-cc61-4409-a105-dfe1e5472abb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c71a17-b960-4748-9d39-f446ff6cbf4c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-quobyte-4937835d-cc61-4409-a105-dfe1e5472abb" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-4937835d-cc61-4409-a105-dfe1e5472abb" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:04 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.359s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Deleted volume successfully. Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a406df-5170-417c-a519-2fb3c5ae401b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e9a90d8e-eab7-4f0b-b3a3-ffc96af072d4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-fe642c61-2b20-47b5-aa10-eb5e12c6ca68-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:04 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f Nov 02 10:16:04 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:04 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb Nov 02 10:16:04 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:05 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f" returned: 0 in 0.442s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:05 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 1G Nov 02 10:16:05 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:05 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb" returned: 0 in 0.455s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:05 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb Nov 02 10:16:05 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:05 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4937835d-cc61-4409-a105-dfe1e5472abb" returned: 0 in 0.289s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-4937835d-cc61-4409-a105-dfe1e5472abb" released by "delete_volume" :: held 0.810s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:05 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 1G" returned: 0 in 0.505s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created reservations ['097037fa-4180-4daf-87c8-e9309f4e9968', 'f8d7e8c7-a2e7-4ea1-8aa0-cf3e177e6b0b', 'ef33016d-b6c6-467f-b377-bee4bba9baca', 'e65a0f9f-71b6-42b9-b369-d8cdd34f6c6b'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:05 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:05 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:05 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:05 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-85e56e85-6510-423e-8292-45502e8ccbc8-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-85e56e85-6510-423e-8292-45502e8ccbc8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-quobyte-85e56e85-6510-423e-8292-45502e8ccbc8" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-85e56e85-6510-423e-8292-45502e8ccbc8" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[206a3ae9-0283-4d51-b26f-1e464229d1bb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:05 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.371s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:05 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 is being set with open permissions: ugo+rw Nov 02 10:16:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:06 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:06 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:06 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.312s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:06 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8 Nov 02 10:16:06 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Deleted volume successfully. Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c56d1e15-fa19-4a0c-b0f4-045561acff6c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-4937835d-cc61-4409-a105-dfe1e5472abb-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:06 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.240s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:06 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.info Nov 02 10:16:06 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:06 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8" returned: 0 in 0.384s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:06 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8 Nov 02 10:16:06 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:06 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.info" returned: 0 in 0.337s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:06 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.info is being set with open permissions: ugo+rw Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:06 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.info Nov 02 10:16:06 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:06 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-85e56e85-6510-423e-8292-45502e8ccbc8" returned: 0 in 0.335s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-85e56e85-6510-423e-8292-45502e8ccbc8" released by "delete_volume" :: held 0.818s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created reservations ['3ae14ce8-9267-4a73-99a2-1fa7f4a6357a', '419adcdd-8c59-4c73-b902-9919f0cb6aa1', 'eba41de1-b976-4fcd-8543-f456e41cc484', '84af574a-1ab1-4d7b-b7a6-cf5bea8c41fc'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:06 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.info" returned: 0 in 0.368s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:06 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:06 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.391s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4fb01ccf-ff03-4fbe-9cf6-491813bc5e6d tempest-SnapshotsActionsTest-1196977088 None] Create snapshot completed successfully Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-da728cd3-09fe-4079-858e-284104b18e0e-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-da728cd3-09fe-4079-858e-284104b18e0e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-quobyte-da728cd3-09fe-4079-858e-284104b18e0e" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-da728cd3-09fe-4079-858e-284104b18e0e" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d829a7b4-6d0a-49d4-ba70-ed9ee2565d03]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:07 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.393s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Deleted volume successfully. Nov 02 10:16:07 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e Nov 02 10:16:07 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ef65af97-537f-4d39-8a4a-e7026c47c088 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-85e56e85-6510-423e-8292-45502e8ccbc8-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:07 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e" returned: 0 in 0.436s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:07 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e Nov 02 10:16:07 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:07 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da728cd3-09fe-4079-858e-284104b18e0e" returned: 0 in 0.308s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-da728cd3-09fe-4079-858e-284104b18e0e" released by "delete_volume" :: held 0.817s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created reservations ['c4e6ecb0-a0b8-4a17-8122-7e56909f885f', '969dfab4-f523-41e0-8f9f-42b0d2c52d02', 'eeee1744-8a49-4b6e-8026-70767c1760e0', '7e8a5f04-a9d5-44e2-9deb-3d088dd3ac03'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:08 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:08 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-b391d7a4-208c-4d01-8241-327f84f8b4ca-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-b391d7a4-208c-4d01-8241-327f84f8b4ca-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-quobyte-b391d7a4-208c-4d01-8241-327f84f8b4ca" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-b391d7a4-208c-4d01-8241-327f84f8b4ca" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dea12f-7181-483b-aa4d-c48957999935]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:08 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.422s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Deleted volume successfully. Nov 02 10:16:08 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca Nov 02 10:16:08 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-27c09faa-bd0d-4851-b484-b3fd36eb6a4c tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-da728cd3-09fe-4079-858e-284104b18e0e-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Creating offline snapshot 902b572d-ffca-47e3-91bd-ab59780a819d of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b25d994-c4ad-4043-b58a-1effcdcd4aa0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:08 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:08 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:09 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca" returned: 0 in 0.476s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:09 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca Nov 02 10:16:09 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:09 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.434s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:09 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d 1G Nov 02 10:16:09 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:09 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b391d7a4-208c-4d01-8241-327f84f8b4ca" returned: 0 in 0.305s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-b391d7a4-208c-4d01-8241-327f84f8b4ca" released by "delete_volume" :: held 0.849s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created reservations ['e7c7dd82-10e6-4ddc-b79e-f9be6788aee5', '8b298ef0-c21a-4cfb-af5b-39321b2dd2cf', 'e335f9eb-0f48-4192-8afc-9856db632e84', 'e40a92b8-730f-4652-97b0-9337bad2f324'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:09 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:09 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-a792f9c9-3696-46a8-9cd9-698fac60d8a5-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-a792f9c9-3696-46a8-9cd9-698fac60d8a5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "cinder-quobyte-a792f9c9-3696-46a8-9cd9-698fac60d8a5" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-a792f9c9-3696-46a8-9cd9-698fac60d8a5" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241fe1e-97a3-4db2-b8e3-ff84fda146bd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:09 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.374s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Deleted volume successfully. Nov 02 10:16:09 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d 1G" returned: 0 in 0.653s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:09 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 Nov 02 10:16:09 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ed818d44-ab6b-4f05-9e50-06de268f65b4 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-b391d7a4-208c-4d01-8241-327f84f8b4ca-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:09 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d Nov 02 10:16:09 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:10 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d" returned: 0 in 0.312s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:10 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d is being set with open permissions: ugo+rw Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:10 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5" returned: 0 in 0.439s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:10 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d Nov 02 10:16:10 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:10 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5 Nov 02 10:16:10 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:10 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:10 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-a792f9c9-3696-46a8-9cd9-698fac60d8a5" returned: 0 in 0.275s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d" returned: 0 in 0.298s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-quobyte-a792f9c9-3696-46a8-9cd9-698fac60d8a5" released by "delete_volume" :: held 0.769s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f65819bc-7fab-4680-9ced-a7116a89ed02 tempest-SnapshotsActionsTest-1196977088 None] Create snapshot completed successfully Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Created reservations ['b6f5daa4-c456-4e28-9330-2e26c5a9c7f9', '0d2ad010-f3fd-4153-af48-c3b61e1c75ee', 'd5431cee-4a30-4178-9f9d-4f9f956e62ce', '528ec815-0593-4929-bc4e-53c966e0ddd2'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:10 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:10 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-902b572d-ffca-47e3-91bd-ab59780a819d-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:11 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.310s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-902b572d-ffca-47e3-91bd-ab59780a819d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:11 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Deleted volume successfully. Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-quobyte-902b572d-ffca-47e3-91bd-ab59780a819d" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0268bd2a-ebc2-4880-a00e-1f4040fd0019 tempest-CreateVolumesFromSourceVolumeTest-257352643 None] Lock "cinder-a792f9c9-3696-46a8-9cd9-698fac60d8a5-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-902b572d-ffca-47e3-91bd-ab59780a819d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Deleting offline snapshot 902b572d-ffca-47e3-91bd-ab59780a819d of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] snapshot_file for this snap is: volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a907bc86-cdfe-4788-97a2-16929d5b0648]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:11 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d Nov 02 10:16:11 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:11 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d" returned: 0 in 0.455s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab195fa-f0f4-4715-96c0-502ff05b555e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:11 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:11 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:12 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.463s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:12 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d Nov 02 10:16:12 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (b63ccf60-fb9c-4af1-8b0e-57ef762e4672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8c2c63-95b0-478b-95a8-87af374bb179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:12 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d" returned: 0 in 0.519s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8c2c63-95b0-478b-95a8-87af374bb179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950501962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3fc052-c60c-402d-8573-be9ba2655ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:13Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa722ca6-f0f8-4c60-979a-eae4489d25d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:12 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d Nov 02 10:16:12 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa722ca6-f0f8-4c60-979a-eae4489d25d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6c6e2a-2324-46a5-8158-3b108af51094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6c6e2a-2324-46a5-8158-3b108af51094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3fc052-c60c-402d-8573-be9ba2655ca6', 'volume_name': 'volume-da3fc052-c60c-402d-8573-be9ba2655ca6', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06eaf9b-8011-4d4b-9a14-17aaecc6ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06eaf9b-8011-4d4b-9a14-17aaecc6ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3431e2bb-a348-4582-8f54-9130cb25fe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:12 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume da3fc052-c60c-402d-8573-be9ba2655ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3fc052-c60c-402d-8573-be9ba2655ca6', 'volume_size': 1} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950501962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3fc052-c60c-402d-8573-be9ba2655ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:13Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Creating volume da3fc052-c60c-402d-8573-be9ba2655ca6 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:12 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:12 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 1073741824 Nov 02 10:16:12 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:12 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.902b572d-ffca-47e3-91bd-ab59780a819d" returned: 0 in 0.297s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-902b572d-ffca-47e3-91bd-ab59780a819d" released by "_delete_snapshot" :: held 1.876s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" released by "delete_snapshot" :: held 1.904s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Created reservations ['4b6300ee-5016-4895-acb3-b0435e5fd619', '20fa1e28-e9dc-4cc1-8a55-d1ccff027f0f', '10c39b2d-1f4f-4a8e-9af3-e6ca1298bbe0', 'd590851d-8619-4436-8e5d-71524bb384d6'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:13 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Delete snapshot completed successfully. Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1f780134-b7a6-45ff-8e7b-8d0aece5d6cb tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-902b572d-ffca-47e3-91bd-ab59780a819d-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:13 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 1073741824" returned: 0 in 0.539s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:13 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 Nov 02 10:16:13 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:13 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6" returned: 0 in 0.352s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Creating offline snapshot 165744b4-9245-47f3-bb05-0671ba2d74e0 of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3431e2bb-a348-4582-8f54-9130cb25fe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3fc052-c60c-402d-8573-be9ba2655ca6', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4ef132-8628-4d71-bcb4-392b9a22a516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1db4d32-bb07-4d26-b94d-0dc4a66952dd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:13 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume volume-da3fc052-c60c-402d-8573-be9ba2655ca6 (da3fc052-c60c-402d-8573-be9ba2655ca6): created successfully Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4ef132-8628-4d71-bcb4-392b9a22a516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (b63ccf60-fb9c-4af1-8b0e-57ef762e4672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:13 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0e6e36a5-cf6c-4caa-b4f6-1af366b586a1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Created volume successfully. Nov 02 10:16:13 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:13 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:14 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.428s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:14 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 1G Nov 02 10:16:14 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:14 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Flow 'volume_create_manager' (0086a14a-2a1f-4032-9051-666a28dfab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b9495c-b266-4204-901a-007e91475b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 1G" returned: 0 in 0.618s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b9495c-b266-4204-901a-007e91475b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffd7635-b6ee-4d0b-968b-5f498bc7135c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d843dc0c39648c9b818690907f4735e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:15Z,use_quota=True,user_id='328a8c7b8a854d85b3dab567fe8340b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:14 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 Nov 02 10:16:14 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210acb10-55c6-4da9-ba66-eda197b71db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210acb10-55c6-4da9-ba66-eda197b71db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a35209b-cc5b-4f3b-bb06-71496a1052a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a35209b-cc5b-4f3b-bb06-71496a1052a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ffd7635-b6ee-4d0b-968b-5f498bc7135c', 'volume_name': 'volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c1dcbe-cfe0-4200-a4bf-2bf0d9c3ad70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c1dcbe-cfe0-4200-a4bf-2bf0d9c3ad70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21c4ff6-3472-49cb-86b2-dd0348561121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:14 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Volume 6ffd7635-b6ee-4d0b-968b-5f498bc7135c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c', 'volume_size': 1} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:15 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0" returned: 0 in 0.327s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:15 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 is being set with open permissions: ugo+rw Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:15 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 Nov 02 10:16:15 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:15 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0" returned: 0 in 0.298s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.794s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffd7635-b6ee-4d0b-968b-5f498bc7135c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d843dc0c39648c9b818690907f4735e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:15Z,use_quota=True,user_id='328a8c7b8a854d85b3dab567fe8340b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Creating volume 6ffd7635-b6ee-4d0b-968b-5f498bc7135c {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:15 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:15 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c 1073741824 Nov 02 10:16:15 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7edeb928-d96d-4e55-8b6c-3222aa637bab tempest-SnapshotsActionsTest-1196977088 None] Create snapshot completed successfully Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-165744b4-9245-47f3-bb05-0671ba2d74e0-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-165744b4-9245-47f3-bb05-0671ba2d74e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-quobyte-165744b4-9245-47f3-bb05-0671ba2d74e0" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-165744b4-9245-47f3-bb05-0671ba2d74e0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Deleting offline snapshot 165744b4-9245-47f3-bb05-0671ba2d74e0 of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] snapshot_file for this snap is: volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee502854-cf7a-47d2-a9c3-339c4d806b0f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:15 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c 1073741824" returned: 0 in 0.507s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:16 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c Nov 02 10:16:16 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:16 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 Nov 02 10:16:16 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:16 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c" returned: 0 in 0.245s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.320s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Creating offline snapshot de4b0741-56b0-4a88-8c6d-248e865a8c32 of volume da3fc052-c60c-402d-8573-be9ba2655ca6 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21c4ff6-3472-49cb-86b2-dd0348561121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005f44aa-0e87-4dae-929b-dd25afdcd597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6072d64f-9d3d-4f36-8835-ded0d462d575]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:16 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0" returned: 0 in 0.376s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:16 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Volume volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c (6ffd7635-b6ee-4d0b-968b-5f498bc7135c): created successfully Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005f44aa-0e87-4dae-929b-dd25afdcd597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Flow 'volume_create_manager' (0086a14a-2a1f-4032-9051-666a28dfab25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb7582-aac8-480d-be7a-7e3c57d59bc5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:16 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2d08f674-8656-4dc5-86ca-6341d1dd6e12 tempest-CinderUnicodeTest-864709016 None] Created volume successfully. Nov 02 10:16:16 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 Nov 02 10:16:16 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:16 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:16 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:16 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6" returned: 0 in 0.384s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:16 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 1G Nov 02 10:16:16 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:16 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.418s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:16 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 Nov 02 10:16:16 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:17 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 1G" returned: 0 in 0.482s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da3fc052-c60c-402d-8573-be9ba2655ca6 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:17 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da3fc052-c60c-402d-8573-be9ba2655ca6 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 Nov 02 10:16:17 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:17 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0" returned: 0 in 0.475s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:17 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0 Nov 02 10:16:17 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Flow 'volume_create_manager' (4d196c56-15c5-4398-8e92-a14839b96d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66ebdee-b906-40d1-8939-b5e810521284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66ebdee-b906-40d1-8939-b5e810521284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1276014815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db56efa5-5a21-49a7-b8c6-29b9d9520090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d843dc0c39648c9b818690907f4735e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:17Z,use_quota=True,user_id='328a8c7b8a854d85b3dab567fe8340b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e32cc71-42b2-405c-9a4b-5258d3eb769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e32cc71-42b2-405c-9a4b-5258d3eb769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0aa989b-ba8e-4cc9-b851-1f33216f1180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0aa989b-ba8e-4cc9-b851-1f33216f1180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db56efa5-5a21-49a7-b8c6-29b9d9520090', 'volume_name': 'volume-db56efa5-5a21-49a7-b8c6-29b9d9520090', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2298b42-aa87-43ff-9370-8c708718ab95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2298b42-aa87-43ff-9370-8c708718ab95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab95132d-6fea-45a4-827a-c59d2c1669d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:17 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Volume db56efa5-5a21-49a7-b8c6-29b9d9520090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db56efa5-5a21-49a7-b8c6-29b9d9520090', 'volume_size': 1} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:17 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da3fc052-c60c-402d-8573-be9ba2655ca6 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32" returned: 0 in 0.347s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:17 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 is being set with open permissions: ugo+rw Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:17 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.165744b4-9245-47f3-bb05-0671ba2d74e0" returned: 0 in 0.278s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:17 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 Nov 02 10:16:17 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-165744b4-9245-47f3-bb05-0671ba2d74e0" released by "_delete_snapshot" :: held 1.666s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" released by "delete_snapshot" :: held 1.690s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Created reservations ['c45e0a98-3b03-4702-9faf-eca1e04228be', '15792b17-fc9a-4778-b9b8-c968f5388baf', '78058108-d605-44db-bdd5-80d66add8bdd', '1d2c9f31-943d-41d8-9b5f-adf61824cc89'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Delete snapshot completed successfully. Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-587683b2-e3c2-46bb-9b6d-b1025600cd51 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-165744b4-9245-47f3-bb05-0671ba2d74e0-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:17 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32" returned: 0 in 0.243s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:17 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.info Nov 02 10:16:17 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:18 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.info" returned: 0 in 0.281s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:18 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.info is being set with open permissions: ugo+rw Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:18 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.info Nov 02 10:16:18 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:18 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.info" returned: 0 in 0.290s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1276014815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db56efa5-5a21-49a7-b8c6-29b9d9520090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d843dc0c39648c9b818690907f4735e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:17Z,use_quota=True,user_id='328a8c7b8a854d85b3dab567fe8340b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Creating volume db56efa5-5a21-49a7-b8c6-29b9d9520090 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:18 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:18 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 1073741824 Nov 02 10:16:18 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:18 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-fb9ebfd2-62b9-4432-812b-413175f8308f tempest-CreateVolumesFromSnapshotTest-267043149 None] Create snapshot completed successfully Nov 02 10:16:18 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 1073741824" returned: 0 in 0.416s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:18 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 Nov 02 10:16:18 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:19 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090" returned: 0 in 0.252s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.756s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab95132d-6fea-45a4-827a-c59d2c1669d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db56efa5-5a21-49a7-b8c6-29b9d9520090', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d87c3b-a954-4803-8228-f3167b2551ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Creating offline snapshot 90403ea0-5ca9-4618-a775-241bd74f15d4 of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:19 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Volume volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 (db56efa5-5a21-49a7-b8c6-29b9d9520090): created successfully Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d87c3b-a954-4803-8228-f3167b2551ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Flow 'volume_create_manager' (4d196c56-15c5-4398-8e92-a14839b96d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e227531b-8d66-4a0e-bf04-9d55e47ce08a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ae02cc77-bb64-4d8a-89fa-3c001d9899ae tempest-CinderUnicodeTest-864709016 None] Created volume successfully. Nov 02 10:16:19 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:19 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:19 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.487s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:19 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 1G Nov 02 10:16:19 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (25e38dc2-26f8-4bb3-af57-3c2e65947715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3202f71-064e-4266-a39d-b666366e02af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3202f71-064e-4266-a39d-b666366e02af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1555652893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69233c62-8dd3-4e95-8907-0d1fc9bcd668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:20Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb964146-552c-45d9-ab13-d5340f7b3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb964146-552c-45d9-ab13-d5340f7b3493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e244c70b-cdd5-437b-a731-f2a714dd9c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e244c70b-cdd5-437b-a731-f2a714dd9c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69233c62-8dd3-4e95-8907-0d1fc9bcd668', 'volume_name': 'volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9335c9ae-4fcb-4b4e-aa92-a7c57c403134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9335c9ae-4fcb-4b4e-aa92-a7c57c403134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a987793-c26f-430d-b1e4-6108e2246193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:19 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume 69233c62-8dd3-4e95-8907-0d1fc9bcd668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668', 'volume_size': 1} Nov 02 10:16:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (8825090a-1eea-4ca2-9670-f28015237c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4175c7-4b50-4054-bb89-fdf88bb01e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4175c7-4b50-4054-bb89-fdf88bb01e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060849330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2089f5e-3070-4e6a-aa6b-66edd26c9b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:20Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790eb817-343b-45dd-bad4-ce99dd08718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790eb817-343b-45dd-bad4-ce99dd08718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa53b0d-34de-49f4-be41-44b6dd687c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa53b0d-34de-49f4-be41-44b6dd687c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2089f5e-3070-4e6a-aa6b-66edd26c9b41', 'volume_name': 'volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e8f459-79cf-42b4-a96b-bb0b2cd99088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e8f459-79cf-42b4-a96b-bb0b2cd99088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8d99ac-0e42-430d-80c1-42303eebb652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume b2089f5e-3070-4e6a-aa6b-66edd26c9b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41', 'volume_size': 1} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 1G" returned: 0 in 0.564s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:20 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 Nov 02 10:16:20 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (b02580eb-3b4e-473e-8915-471a49357417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f85f163-400b-449a-a001-ec9d042d3bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f85f163-400b-449a-a001-ec9d042d3bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142626760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b008826-cfad-4b72-944c-e8044c4d8466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:20Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d52650e-0788-4c82-a05f-22b13c31ead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d52650e-0788-4c82-a05f-22b13c31ead0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170bccee-addc-4bf6-9042-8d4ca0df221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170bccee-addc-4bf6-9042-8d4ca0df221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b008826-cfad-4b72-944c-e8044c4d8466', 'volume_name': 'volume-1b008826-cfad-4b72-944c-e8044c4d8466', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7ffb78-1077-4c28-b9a7-15415d6af407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7ffb78-1077-4c28-b9a7-15415d6af407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb53724-d7cd-4cb2-966f-340831aea300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:20 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume 1b008826-cfad-4b72-944c-e8044c4d8466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b008826-cfad-4b72-944c-e8044c4d8466', 'volume_size': 1} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4" returned: 0 in 0.394s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:20 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 is being set with open permissions: ugo+rw Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:20 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 Nov 02 10:16:20 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:20 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:20 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:20 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4" returned: 0 in 0.285s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.880s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.133s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (c5ebae9c-e3ef-4782-bc45-8a95e38abcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f4213d-cc6d-4fc3-960d-f819d7eea27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Creating offline snapshot c86cc2b9-3e0a-4c79-b325-751dac395ec4 of volume db56efa5-5a21-49a7-b8c6-29b9d9520090 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:21 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.302s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f4213d-cc6d-4fc3-960d-f819d7eea27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-469260980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b9e50-2403-4c13-991e-00fd7350fb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:21Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1239ee5e-db26-46ad-a6f5-1d49045e9e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1239ee5e-db26-46ad-a6f5-1d49045e9e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c483e652-b043-4f61-a14c-c951464864e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c483e652-b043-4f61-a14c-c951464864e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0b9e50-2403-4c13-991e-00fd7350fb2b', 'volume_name': 'volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fef0562-bbde-4d67-8d2a-c37f5f47a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fef0562-bbde-4d67-8d2a-c37f5f47a120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b443209a-39a7-4a70-9457-0833b4668a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume 2f0b9e50-2403-4c13-991e-00fd7350fb2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b', 'volume_size': 1} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[06507dca-fbf5-4039-89e8-c9888e036ef4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:21 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-991751ed-bc6b-4aef-a0f0-ef0afc73fae8 tempest-SnapshotsActionsTest-1196977088 None] Create snapshot completed successfully Nov 02 10:16:21 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 Nov 02 10:16:21 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (05a0e5e3-485c-4569-a233-053acebd4395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a9cfdb-38d6-4aca-b4ba-a199c85ecfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a9cfdb-38d6-4aca-b4ba-a199c85ecfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593386198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35954f3-d07b-4923-b1fb-e055a0ecf942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:21Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca2c0c5-402c-4c7a-973c-fd36d877d7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca2c0c5-402c-4c7a-973c-fd36d877d7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b7fdf1-0e85-4df5-bffb-a77ae764e49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b7fdf1-0e85-4df5-bffb-a77ae764e49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35954f3-d07b-4923-b1fb-e055a0ecf942', 'volume_name': 'volume-f35954f3-d07b-4923-b1fb-e055a0ecf942', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bb7180-a991-40f6-98aa-02ade2647dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bb7180-a991-40f6-98aa-02ade2647dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c01267e-16c6-4827-b194-04f464388fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume f35954f3-d07b-4923-b1fb-e055a0ecf942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35954f3-d07b-4923-b1fb-e055a0ecf942', 'volume_size': 1} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:21 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090" returned: 0 in 0.406s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:21 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 1G Nov 02 10:16:21 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-90403ea0-5ca9-4618-a775-241bd74f15d4-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-90403ea0-5ca9-4618-a775-241bd74f15d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-quobyte-90403ea0-5ca9-4618-a775-241bd74f15d4" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-90403ea0-5ca9-4618-a775-241bd74f15d4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Deleting offline snapshot 90403ea0-5ca9-4618-a775-241bd74f15d4 of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] snapshot_file for this snap is: volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cda79d5-cbf7-4d16-b175-08a3fc308f50]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:21 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 Nov 02 10:16:21 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:21 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 1G" returned: 0 in 0.430s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:21 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 Nov 02 10:16:21 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4" returned: 0 in 0.389s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eea711d-7a16-4e3c-8e91-b3a087c3f00f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:22 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4" returned: 0 in 0.309s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 is being set with open permissions: ugo+rw Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 Nov 02 10:16:22 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4" returned: 0 in 0.262s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.423s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 Nov 02 10:16:22 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.info Nov 02 10:16:22 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.info" returned: 0 in 0.269s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.info is being set with open permissions: ugo+rw Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.info Nov 02 10:16:22 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:22 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4" returned: 0 in 0.395s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:22 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4 Nov 02 10:16:22 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:23 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.info" returned: 0 in 0.262s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.192s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1555652893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69233c62-8dd3-4e95-8907-0d1fc9bcd668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:20Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Creating volume 69233c62-8dd3-4e95-8907-0d1fc9bcd668 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:23 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:23 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 1073741824 Nov 02 10:16:23 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:23 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8b25df0c-a1a4-468a-8d24-ced23fbe0eef tempest-CinderUnicodeTest-864709016 None] Create snapshot completed successfully Nov 02 10:16:23 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.90403ea0-5ca9-4618-a775-241bd74f15d4" returned: 0 in 0.276s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-90403ea0-5ca9-4618-a775-241bd74f15d4" released by "_delete_snapshot" :: held 1.595s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" released by "delete_snapshot" :: held 1.622s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Created reservations ['c694516f-06c7-441c-aa45-3bf00ebd4b9f', '4217f338-718e-4f09-8a8a-30d3be6bfce6', '1fc300e1-428f-4d38-9cf4-9f3a903e3653', '500c7616-0d7d-420f-bc03-794d08375af5'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:23 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Delete snapshot completed successfully. Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-894f8a56-b20c-4be2-98ad-f5629c63281d tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-90403ea0-5ca9-4618-a775-241bd74f15d4-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:23 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 1073741824" returned: 0 in 0.461s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:23 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 Nov 02 10:16:23 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:23 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668" returned: 0 in 0.296s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.706s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060849330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2089f5e-3070-4e6a-aa6b-66edd26c9b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:20Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Creating volume b2089f5e-3070-4e6a-aa6b-66edd26c9b41 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:23 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Acquiring lock "cinder-c86cc2b9-3e0a-4c79-b325-751dac395ec4-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:24 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 1073741824 Nov 02 10:16:24 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a987793-c26f-430d-b1e4-6108e2246193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78435f1-d870-4cdc-9ff0-7f4a15a4f8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-c86cc2b9-3e0a-4c79-b325-751dac395ec4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Acquiring lock "cinder-quobyte-db56efa5-5a21-49a7-b8c6-29b9d9520090" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:24 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 (69233c62-8dd3-4e95-8907-0d1fc9bcd668): created successfully Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78435f1-d870-4cdc-9ff0-7f4a15a4f8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (25e38dc2-26f8-4bb3-af57-3c2e65947715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-quobyte-db56efa5-5a21-49a7-b8c6-29b9d9520090" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Acquiring lock "cinder-quobyte-c86cc2b9-3e0a-4c79-b325-751dac395ec4" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:24 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1e1e3b73-cb91-4e1b-8588-7368b5377cef tempest-CreateVolumesFromSnapshotTest-267043149 None] Created volume successfully. Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-quobyte-c86cc2b9-3e0a-4c79-b325-751dac395ec4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Deleting offline snapshot c86cc2b9-3e0a-4c79-b325-751dac395ec4 of volume db56efa5-5a21-49a7-b8c6-29b9d9520090 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] snapshot_file for this snap is: volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efeaa93-5042-4dd2-9853-fd5f7e702419]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:24 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 Nov 02 10:16:24 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:24 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 1073741824" returned: 0 in 0.547s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:24 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4" returned: 0 in 0.384s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db56efa5-5a21-49a7-b8c6-29b9d9520090(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70af283-2836-4943-9c0f-54c88a0e5a7e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:24 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 Nov 02 10:16:24 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:24 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 Nov 02 10:16:24 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:24 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41" returned: 0 in 0.246s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.181s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142626760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b008826-cfad-4b72-944c-e8044c4d8466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:20Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Creating volume 1b008826-cfad-4b72-944c-e8044c4d8466 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:24 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8d99ac-0e42-430d-80c1-42303eebb652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e7c71a-7f8a-44ae-a16e-0c3f1a37ac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:24 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466 1073741824 Nov 02 10:16:24 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:24 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 (b2089f5e-3070-4e6a-aa6b-66edd26c9b41): created successfully Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e7c71a-7f8a-44ae-a16e-0c3f1a37ac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (8825090a-1eea-4ca2-9670-f28015237c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:24 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8fe6a689-973a-42a1-bd30-017016d4962f tempest-CreateVolumesFromSnapshotTest-267043149 None] Created volume successfully. Nov 02 10:16:24 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090" returned: 0 in 0.390s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:25 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 Nov 02 10:16:25 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:25 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466 1073741824" returned: 0 in 0.471s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:25 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4" returned: 0 in 0.375s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:25 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4 Nov 02 10:16:25 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:25 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466 Nov 02 10:16:25 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:25 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090.c86cc2b9-3e0a-4c79-b325-751dac395ec4" returned: 0 in 0.271s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:25 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466" returned: 0 in 0.293s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.538s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-469260980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0b9e50-2403-4c13-991e-00fd7350fb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:21Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Creating volume 2f0b9e50-2403-4c13-991e-00fd7350fb2b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:25 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-quobyte-c86cc2b9-3e0a-4c79-b325-751dac395ec4" released by "_delete_snapshot" :: held 1.559s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-quobyte-db56efa5-5a21-49a7-b8c6-29b9d9520090" released by "delete_snapshot" :: held 1.603s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:25 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b 1073741824 Nov 02 10:16:25 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb53724-d7cd-4cb2-966f-340831aea300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b008826-cfad-4b72-944c-e8044c4d8466', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc2d5c0-e3c4-4b12-879b-a757f29035a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:25 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume volume-1b008826-cfad-4b72-944c-e8044c4d8466 (1b008826-cfad-4b72-944c-e8044c4d8466): created successfully Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc2d5c0-e3c4-4b12-879b-a757f29035a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (b02580eb-3b4e-473e-8915-471a49357417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-eda03a9a-ed59-4353-960a-b367b5676a38 tempest-CreateVolumesFromSnapshotTest-267043149 None] Created volume successfully. Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Created reservations ['68d67c27-c53d-46a6-a5bf-021673a0f6d5', '1de46f20-c8c9-4545-913e-dcf9825b03ed', '962eed89-d2fc-4146-b011-1a494de59068', 'bf96adaa-4c9a-44df-a847-aaecc9fe8b6e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Delete snapshot completed successfully. Nov 02 10:16:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-44096c8f-1445-42b3-b9ab-6371b9b9859f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-c86cc2b9-3e0a-4c79-b325-751dac395ec4-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:26 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Acquiring lock "cinder-db56efa5-5a21-49a7-b8c6-29b9d9520090-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b 1073741824" returned: 0 in 0.461s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-db56efa5-5a21-49a7-b8c6-29b9d9520090-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:26 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b Nov 02 10:16:26 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Acquiring lock "cinder-quobyte-db56efa5-5a21-49a7-b8c6-29b9d9520090" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-quobyte-db56efa5-5a21-49a7-b8c6-29b9d9520090" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4bff02-bccc-4b6e-9986-7580292e945b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:26 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 Nov 02 10:16:26 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:26 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b" returned: 0 in 0.263s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.064s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593386198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35954f3-d07b-4923-b1fb-e055a0ecf942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870611b5e47d47668f2f2d9cffffeb49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:21Z,use_quota=True,user_id='5d8bcec1289149fc8f9a54d1ac8a0368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Creating volume f35954f3-d07b-4923-b1fb-e055a0ecf942 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:26 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b443209a-39a7-4a70-9457-0833b4668a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:26 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 1073741824 Nov 02 10:16:26 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab17009d-279a-4505-b48a-e422f79d7dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=152,cinder:UPDATE=164,cinder:INSERT=37,cinder:DELETE=14 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:16:26 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b (2f0b9e50-2403-4c13-991e-00fd7350fb2b): created successfully Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab17009d-279a-4505-b48a-e422f79d7dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (c5ebae9c-e3ef-4782-bc45-8a95e38abcef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-27e04677-5275-4f20-ab24-231656b8490a tempest-CreateVolumesFromSnapshotTest-267043149 None] Created volume successfully. Nov 02 10:16:26 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090" returned: 0 in 0.388s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:26 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090 Nov 02 10:16:26 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:26 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 1073741824" returned: 0 in 0.485s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:26 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-db56efa5-5a21-49a7-b8c6-29b9d9520090" returned: 0 in 0.303s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-quobyte-db56efa5-5a21-49a7-b8c6-29b9d9520090" released by "delete_volume" :: held 0.766s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:27 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 Nov 02 10:16:27 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Created reservations ['08fbb836-1e8b-4c6d-af5c-863438694204', '12879ea7-9691-4911-b5c8-83017e291505', 'fbea1700-c77b-40b3-a5a2-ca751e932b33', '77b8654e-8376-45e3-a0ac-e2b92a4b28da'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:27 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:27 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:27 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Acquiring lock "cinder-6ffd7635-b6ee-4d0b-968b-5f498bc7135c-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942" returned: 0 in 0.307s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.184s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Creating offline snapshot 6470ebaa-31f4-4eba-bd5c-59085c92a197 of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Lock "cinder-6ffd7635-b6ee-4d0b-968b-5f498bc7135c-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c01267e-16c6-4827-b194-04f464388fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35954f3-d07b-4923-b1fb-e055a0ecf942', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7f5326-53c9-4d62-9f8a-f5725f80810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ef8b4f-ef32-445e-ad4f-f1ff80e358ab]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:27 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.298s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:27 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Deleted volume successfully. Nov 02 10:16:27 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Volume volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 (f35954f3-d07b-4923-b1fb-e055a0ecf942): created successfully Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7f5326-53c9-4d62-9f8a-f5725f80810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Flow 'volume_create_manager' (05a0e5e3-485c-4569-a233-053acebd4395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:27 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-660fad79-4d10-421e-847f-0492f4776182 tempest-CreateVolumesFromSnapshotTest-267043149 None] Created volume successfully. Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Acquiring lock "cinder-quobyte-6ffd7635-b6ee-4d0b-968b-5f498bc7135c" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9a845a8b-46d1-4704-b063-00591959e33f tempest-CinderUnicodeTest-864709016 None] Lock "cinder-db56efa5-5a21-49a7-b8c6-29b9d9520090-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Lock "cinder-quobyte-6ffd7635-b6ee-4d0b-968b-5f498bc7135c" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:27 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:27 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db27888-6e79-4403-a1a4-4ec2b1d5e4e4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:27 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c Nov 02 10:16:27 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:27 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.369s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:27 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 1G Nov 02 10:16:27 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:27 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-f35954f3-d07b-4923-b1fb-e055a0ecf942-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c" returned: 0 in 0.423s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-f35954f3-d07b-4923-b1fb-e055a0ecf942-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:28 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c Nov 02 10:16:28 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-quobyte-f35954f3-d07b-4923-b1fb-e055a0ecf942" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-f35954f3-d07b-4923-b1fb-e055a0ecf942" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab975f55-ebaf-40b4-81c4-385d83ecb54a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:28 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 Nov 02 10:16:28 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:28 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6ffd7635-b6ee-4d0b-968b-5f498bc7135c" returned: 0 in 0.323s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:28 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 1G" returned: 0 in 0.523s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Lock "cinder-quobyte-6ffd7635-b6ee-4d0b-968b-5f498bc7135c" released by "delete_volume" :: held 0.802s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:28 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 Nov 02 10:16:28 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Created reservations ['b8786aeb-ed7c-44fe-b0d0-5e18b07d50d3', '775b5029-32e9-460d-bf44-4fdb7470c2fd', '66fd8a30-7b71-4dc7-b6f4-d5e941dba069', '2d739802-d631-4b31-bd0e-3d480d578520'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:28 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:28 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:28 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942" returned: 0 in 0.441s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:28 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942 Nov 02 10:16:28 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:28 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197" returned: 0 in 0.350s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:28 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 is being set with open permissions: ugo+rw Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:28 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 Nov 02 10:16:28 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:28 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.297s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Deleted volume successfully. Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-26b86876-f13e-40ed-a62f-d8bc8142e14d tempest-CinderUnicodeTest-864709016 None] Lock "cinder-6ffd7635-b6ee-4d0b-968b-5f498bc7135c-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:28 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f35954f3-d07b-4923-b1fb-e055a0ecf942" returned: 0 in 0.308s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-f35954f3-d07b-4923-b1fb-e055a0ecf942" released by "delete_volume" :: held 0.804s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Created reservations ['9d0906a6-1834-4233-b755-be1134c371cc', '23ac499d-63af-42f6-9058-2158a4f2a135', '5b9b908c-c853-4656-9ec0-7b4388609d2c', '9d4c0965-2891-47ad-bcd4-638dd08744ec'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:28 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197" returned: 0 in 0.309s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.687s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:29 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bb50e467-5464-4b11-8600-fbe43cc51d7b tempest-SnapshotsActionsTest-1196977088 None] Create snapshot completed successfully Nov 02 10:16:29 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:29 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-2f0b9e50-2403-4c13-991e-00fd7350fb2b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-2f0b9e50-2403-4c13-991e-00fd7350fb2b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-quobyte-2f0b9e50-2403-4c13-991e-00fd7350fb2b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-2f0b9e50-2403-4c13-991e-00fd7350fb2b" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa83aa90-c8f1-42c5-96ca-c8081d54a790]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:29 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.363s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:29 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Deleted volume successfully. Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65b31dab-cbc1-43a7-87f1-7503155d3484 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-f35954f3-d07b-4923-b1fb-e055a0ecf942-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:29 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b Nov 02 10:16:29 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-6470ebaa-31f4-4eba-bd5c-59085c92a197-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-6470ebaa-31f4-4eba-bd5c-59085c92a197-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Acquiring lock "cinder-quobyte-6470ebaa-31f4-4eba-bd5c-59085c92a197" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-6470ebaa-31f4-4eba-bd5c-59085c92a197" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Deleting offline snapshot 6470ebaa-31f4-4eba-bd5c-59085c92a197 of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] snapshot_file for this snap is: volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9a32f2-f278-4c34-97fe-163f87e9bdb9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:29 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 Nov 02 10:16:29 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:29 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b" returned: 0 in 0.557s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:29 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b Nov 02 10:16:29 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:30 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197" returned: 0 in 0.450s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d024e621-1b14-4fe6-9843-fdab47603eab]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:30 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2f0b9e50-2403-4c13-991e-00fd7350fb2b" returned: 0 in 0.301s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-2f0b9e50-2403-4c13-991e-00fd7350fb2b" released by "delete_volume" :: held 0.939s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=212,cinder:SELECT=155,cinder:INSERT=52,cinder:DELETE=18 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Created reservations ['d826a6cc-719e-41a7-869f-bc309b74b8d2', '360c5c1b-86c4-49a0-88f5-b77022f357e4', '071b2039-55c4-4faf-93bf-b8e988f3b96b', '1a2d01f1-e5b9-4fb6-8324-b4c7d1bf3043'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:30 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:30 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:30 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:30 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:30 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.486s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:30 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 Nov 02 10:16:30 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:30 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.286s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:30 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Deleted volume successfully. Nov 02 10:16:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-56d61f73-c254-4be1-aad0-6eba65e5e40b tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-2f0b9e50-2403-4c13-991e-00fd7350fb2b-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:31 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197" returned: 0 in 0.406s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:31 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197 Nov 02 10:16:31 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:31 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.6470ebaa-31f4-4eba-bd5c-59085c92a197" returned: 0 in 0.271s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-6470ebaa-31f4-4eba-bd5c-59085c92a197" released by "_delete_snapshot" :: held 1.744s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" released by "delete_snapshot" :: held 1.782s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-1b008826-cfad-4b72-944c-e8044c4d8466-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Created reservations ['5151bb24-0883-4083-832a-03085bded6da', '6c182298-cfd3-4e15-92fc-a40acae5c731', '0e4fe808-e019-40fb-9491-d6d06180c515', 'bcf863de-95ba-47b0-ad16-886a7dd75003'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-1b008826-cfad-4b72-944c-e8044c4d8466-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-quobyte-1b008826-cfad-4b72-944c-e8044c4d8466" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Delete snapshot completed successfully. Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-1b008826-cfad-4b72-944c-e8044c4d8466" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-eb4290b3-23ef-4e42-99d3-bea0a6eb5d10 tempest-SnapshotsActionsTest-625811284 None] Lock "cinder-6470ebaa-31f4-4eba-bd5c-59085c92a197-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[474bd74e-4142-42ec-92e2-579820aa409e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:31 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466 Nov 02 10:16:31 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:32 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466" returned: 0 in 0.451s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:32 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466 Nov 02 10:16:32 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:32 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1b008826-cfad-4b72-944c-e8044c4d8466" returned: 0 in 0.292s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-1b008826-cfad-4b72-944c-e8044c4d8466" released by "delete_volume" :: held 0.803s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Created reservations ['c8868a54-e3c9-475e-ae7c-848b3010a49a', '99c4268e-6703-461e-8489-bee3b943a3f5', 'ecbade95-6496-40a1-994c-aa35109e9750', 'e2de3847-9d86-44ad-a01f-2a6c7c75280a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "cinder-054a9892-2a46-4794-9cea-2fde5c767367-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-054a9892-2a46-4794-9cea-2fde5c767367-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:32 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:32 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "cinder-quobyte-054a9892-2a46-4794-9cea-2fde5c767367" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-quobyte-054a9892-2a46-4794-9cea-2fde5c767367" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Deleting offline snapshot 054a9892-2a46-4794-9cea-2fde5c767367 of volume f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] snapshot_file for this snap is: volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-b2089f5e-3070-4e6a-aa6b-66edd26c9b41-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-b2089f5e-3070-4e6a-aa6b-66edd26c9b41-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[57303ffd-b372-4b6b-843a-dcf98e3c160d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-quobyte-b2089f5e-3070-4e6a-aa6b-66edd26c9b41" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-b2089f5e-3070-4e6a-aa6b-66edd26c9b41" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b1725a-0555-4308-86fa-43f87953884b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:32 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:32 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:32 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.382s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:32 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:32 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Deleted volume successfully. Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1157c1f-7776-4d9f-a087-ad1994e9008a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-1b008826-cfad-4b72-944c-e8044c4d8466-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:33 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 Nov 02 10:16:33 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:33 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.500s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4eaca1f-dba9-400d-9086-c311a17a519f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3dc2b7-27ca-4095-9703-4f2a6acacb27]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:33 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41" returned: 0 in 0.505s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:33 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41 Nov 02 10:16:33 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:33 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f Nov 02 10:16:33 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:33 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2089f5e-3070-4e6a-aa6b-66edd26c9b41" returned: 0 in 0.294s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-b2089f5e-3070-4e6a-aa6b-66edd26c9b41" released by "delete_volume" :: held 0.894s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:33 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f" returned: 0 in 0.452s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:33 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:33 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Created reservations ['344959ca-bb24-47e4-9780-8e1fc3ed1edd', '014399a5-41f1-4c5b-b9d2-9e2c1198c493', 'a230787b-c094-4446-a374-c568a3279f86', '3fa6dc52-bf8f-4697-8761-d78da9ccf844'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:33 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:33 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:34 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.430s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:34 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367 Nov 02 10:16:34 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:34 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.288s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Deleted volume successfully. Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5f5679df-0c7e-4ac3-80ca-7c52b956c31a tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-b2089f5e-3070-4e6a-aa6b-66edd26c9b41-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:34 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f.054a9892-2a46-4794-9cea-2fde5c767367" returned: 0 in 0.287s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-quobyte-054a9892-2a46-4794-9cea-2fde5c767367" released by "_delete_snapshot" :: held 1.873s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" released by "delete_snapshot" :: held 1.912s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Created reservations ['726b4dbb-cbef-486c-a067-763ff88e821e', '87b36a72-1cc9-4330-abdf-fb8adf4e9761', '1d74d219-ba89-42e4-aca5-a1ce30bd44b1', '8015ac82-2159-4829-a351-936218271031'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Delete snapshot completed successfully. Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3b0ed5c1-76ba-4825-9f76-6d7d7da79f4f tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-054a9892-2a46-4794-9cea-2fde5c767367-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "cinder-f4eaca1f-dba9-400d-9086-c311a17a519f-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-f4eaca1f-dba9-400d-9086-c311a17a519f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[352607c3-b46c-4a03-bfff-ec6522cd31d6]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-69233c62-8dd3-4e95-8907-0d1fc9bcd668-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-69233c62-8dd3-4e95-8907-0d1fc9bcd668-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-quobyte-69233c62-8dd3-4e95-8907-0d1fc9bcd668" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-69233c62-8dd3-4e95-8907-0d1fc9bcd668" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:35 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f Nov 02 10:16:35 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bafdf6-7aac-4e69-a0a5-7aaf16f26685]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:35 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 Nov 02 10:16:35 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:35 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f" returned: 0 in 0.461s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:35 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f Nov 02 10:16:35 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:35 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668" returned: 0 in 0.454s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:35 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668 Nov 02 10:16:35 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:35 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4eaca1f-dba9-400d-9086-c311a17a519f" returned: 0 in 0.301s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-quobyte-f4eaca1f-dba9-400d-9086-c311a17a519f" released by "delete_volume" :: held 0.861s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Created reservations ['f89d0efb-bb9d-410d-ba8a-ecc48acdab37', '2249cbef-eb6d-4040-b3d9-9dd08bd0025d', 'c24f7c9c-c8b7-49a4-8178-1746e12f3999', '0efcdb00-3fc5-4e84-9137-41ef40db48e3'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:36 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:36 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:36 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69233c62-8dd3-4e95-8907-0d1fc9bcd668" returned: 0 in 0.400s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-69233c62-8dd3-4e95-8907-0d1fc9bcd668" released by "delete_volume" :: held 0.916s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Created reservations ['2b6b265d-4eab-4814-90ec-4b0f5e63efae', '2aabbe98-77f8-495c-ad2a-5514e52f2ca4', '28555f62-bf0a-425a-81ac-7c8732118342', 'b0a707d8-e537-48ea-8029-94969eb5df8a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:36 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:36 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:36 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-de4b0741-56b0-4a88-8c6d-248e865a8c32-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.423s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-de4b0741-56b0-4a88-8c6d-248e865a8c32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-quobyte-da3fc052-c60c-402d-8573-be9ba2655ca6" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:36 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Deleted volume successfully. Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-da3fc052-c60c-402d-8573-be9ba2655ca6" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-quobyte-de4b0741-56b0-4a88-8c6d-248e865a8c32" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b8f0f54-089b-4e37-bc1e-60ec3ec2c1c8 tempest-SnapshotsActionsTest-1196977088 None] Lock "cinder-f4eaca1f-dba9-400d-9086-c311a17a519f-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-de4b0741-56b0-4a88-8c6d-248e865a8c32" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Deleting offline snapshot de4b0741-56b0-4a88-8c6d-248e865a8c32 of volume da3fc052-c60c-402d-8573-be9ba2655ca6 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] snapshot_file for this snap is: volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8341dd9b-b31c-4ebb-ba50-2378dd213a72]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:36 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 Nov 02 10:16:36 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:36 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.518s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:36 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Deleted volume successfully. Nov 02 10:16:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45f54d24-e383-434b-917b-5cdc82a50828 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-69233c62-8dd3-4e95-8907-0d1fc9bcd668-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:37 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32" returned: 0 in 0.393s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da3fc052-c60c-402d-8573-be9ba2655ca6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:16:37 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3734a9-3b16-4bcd-b599-231e0d8d0da7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:37 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 Nov 02 10:16:37 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:37 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6" returned: 0 in 0.399s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:37 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 Nov 02 10:16:37 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:37 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32" returned: 0 in 0.367s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:37 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32 Nov 02 10:16:37 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:38 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6.de4b0741-56b0-4a88-8c6d-248e865a8c32" returned: 0 in 0.287s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-de4b0741-56b0-4a88-8c6d-248e865a8c32" released by "_delete_snapshot" :: held 1.607s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-da3fc052-c60c-402d-8573-be9ba2655ca6" released by "delete_snapshot" :: held 1.666s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Created reservations ['7512a804-b185-412e-8998-ec090ed0bbd4', '7436b040-1d43-4020-b933-d72723b8481d', 'cd7b55c6-aa43-4163-9294-6627ab26d514', 'd1998012-44b2-40f6-8d8d-417f2dfd41d4'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Delete snapshot completed successfully. Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cc02327d-4223-4e79-b6fe-31e14859304f tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-de4b0741-56b0-4a88-8c6d-248e865a8c32-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-da3fc052-c60c-402d-8573-be9ba2655ca6-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-da3fc052-c60c-402d-8573-be9ba2655ca6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "cinder-quobyte-da3fc052-c60c-402d-8573-be9ba2655ca6" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-da3fc052-c60c-402d-8573-be9ba2655ca6" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e7ddf2-e6e7-4dbc-afd5-f2ab0b1c4a89]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:38 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 Nov 02 10:16:38 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:39 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6" returned: 0 in 0.441s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:39 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6 Nov 02 10:16:39 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:39 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da3fc052-c60c-402d-8573-be9ba2655ca6" returned: 0 in 0.264s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-quobyte-da3fc052-c60c-402d-8573-be9ba2655ca6" released by "delete_volume" :: held 0.806s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Created reservations ['ab651b99-5f53-4370-b124-f711e45397f6', '8e08afed-ea18-48e9-b85f-e0cfb532ff61', '4915821f-af3c-4a9b-9e9f-0a2a9a430409', '58384273-44fa-46d8-9813-b0bae0a3c7c0'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:39 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:39 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:39 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.272s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Deleted volume successfully. Nov 02 10:16:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c85f8e4f-45e9-4646-a8ac-f49282a50ae1 tempest-CreateVolumesFromSnapshotTest-267043149 None] Lock "cinder-da3fc052-c60c-402d-8573-be9ba2655ca6-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:45 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Flow 'volume_create_manager' (bdcd7ba7-2521-4dcd-b2d8-bf87469bf926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0fd778-7319-4865-b187-018bd92a5869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0fd778-7319-4865-b187-018bd92a5869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc75ed4b-9900-4347-b19c-991d88a0222c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5335d9c394cdb94605b222ee30617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:46Z,use_quota=True,user_id='71b0e99d337a46408e0c644373a1282c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b0546e-0be7-43ca-805c-e8a8883cb164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b0546e-0be7-43ca-805c-e8a8883cb164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f248906b-368a-426a-a47c-d05f816f98e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f248906b-368a-426a-a47c-d05f816f98e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc75ed4b-9900-4347-b19c-991d88a0222c', 'volume_name': 'volume-cc75ed4b-9900-4347-b19c-991d88a0222c', 'volume_size': 1, 'image_id': '4326aaaf-97bf-45e6-8122-a4dcc022d063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4326aaaf-97bf-45e6-8122-a4dcc022d063', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b0d34fd3f90aac974294f7db9f08174', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c2a5335d9c394cdb94605b222ee30617', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2a424608f7b02f3beca560689ca7f0d0aa94a4b97156bb1e56c1c43167583c83b9244b8fb2c1a797a2c398dbfefc03252b39658ccc89a4a915077d610da6414', 'id': '4326aaaf-97bf-45e6-8122-a4dcc022d063', 'created_at': datetime.datetime(2026, 11, 2, 9, 16, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 16, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4326aaaf-97bf-45e6-8122-a4dcc022d063/file', 'properties': {}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae40b34a-d519-41a8-800f-4958d39a579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae40b34a-d519-41a8-800f-4958d39a579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4633298e-865e-4bd2-a79b-745dae042fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Volume cc75ed4b-9900-4347-b19c-991d88a0222c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc75ed4b-9900-4347-b19c-991d88a0222c', 'volume_size': 1, 'image_id': '4326aaaf-97bf-45e6-8122-a4dcc022d063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4326aaaf-97bf-45e6-8122-a4dcc022d063', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b0d34fd3f90aac974294f7db9f08174', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c2a5335d9c394cdb94605b222ee30617', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2a424608f7b02f3beca560689ca7f0d0aa94a4b97156bb1e56c1c43167583c83b9244b8fb2c1a797a2c398dbfefc03252b39658ccc89a4a915077d610da6414', 'id': '4326aaaf-97bf-45e6-8122-a4dcc022d063', 'created_at': datetime.datetime(2026, 11, 2, 9, 16, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 16, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4326aaaf-97bf-45e6-8122-a4dcc022d063/file', 'properties': {}}, 'image_service': } Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Trying to clone cc75ed4b-9900-4347-b19c-991d88a0222c from image 4326aaaf-97bf-45e6-8122-a4dcc022d063 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4326aaaf-97bf-45e6-8122-a4dcc022d063', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:16:46 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06006b7-803c-40d8-826a-b629ac69b24f]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:46 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD Nov 02 10:16:46 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:47 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:47 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD Nov 02 10:16:47 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:47 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD" returned: 1 in 0.352s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:16:47 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Temporary image 4326aaaf-97bf-45e6-8122-a4dcc022d063 is fetched for user 71b0e99d337a46408e0c644373a1282c. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:16:47 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb9585c-bed8-4460-9526-949c23489bf0]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:47 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD Nov 02 10:16:47 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:47 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:47 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD Nov 02 10:16:47 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:48 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD" returned: 1 in 0.422s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc75ed4b-9900-4347-b19c-991d88a0222c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a5335d9c394cdb94605b222ee30617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:46Z,use_quota=True,user_id='71b0e99d337a46408e0c644373a1282c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Creating volume cc75ed4b-9900-4347-b19c-991d88a0222c {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:48 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:48 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c 1073741824 Nov 02 10:16:48 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:48 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c 1073741824" returned: 0 in 0.527s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:48 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c Nov 02 10:16:48 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:49 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c" returned: 0 in 0.276s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Attempting download of 4326aaaf-97bf-45e6-8122-a4dcc022d063 ((None, [{'url': 'file:///opt/stack/data/glance/images/4326aaaf-97bf-45e6-8122-a4dcc022d063', 'metadata': {}}])) to volume cc75ed4b-9900-4347-b19c-991d88a0222c. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[add79a2f-7aba-4975-8dc7-c97a03282827]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4326aaaf-97bf-45e6-8122-a4dcc022d063_9sm73yo7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:49 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4326aaaf-97bf-45e6-8122-a4dcc022d063_9sm73yo7 Nov 02 10:16:49 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:49 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4326aaaf-97bf-45e6-8122-a4dcc022d063_9sm73yo7" returned: 0 in 0.375s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4326aaaf-97bf-45e6-8122-a4dcc022d063_9sm73yo7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:49 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4326aaaf-97bf-45e6-8122-a4dcc022d063_9sm73yo7 Nov 02 10:16:49 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:49 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4326aaaf-97bf-45e6-8122-a4dcc022d063_9sm73yo7" returned: 1 in 0.328s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4326aaaf-97bf-45e6-8122-a4dcc022d063_9sm73yo7' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a713afb-e856-4134-936a-7fc62c1fd220]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:49 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD Nov 02 10:16:49 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:50 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:50 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD Nov 02 10:16:50 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:50 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:16:50 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] 4326aaaf-97bf-45e6-8122-a4dcc022d063 was raw, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:16:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:50 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c Nov 02 10:16:50 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:51 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c" returned: 0 in 0.490s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4326aaaf-97bf-45e6-8122-a4dcc022d063_c_muyuv6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:16:51 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:51 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c 1G Nov 02 10:16:51 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:51 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c 1G" returned: 0 in 0.371s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Downloaded image 4326aaaf-97bf-45e6-8122-a4dcc022d063 ((None, [{'url': 'file:///opt/stack/data/glance/images/4326aaaf-97bf-45e6-8122-a4dcc022d063', 'metadata': {}}])) to volume cc75ed4b-9900-4347-b19c-991d88a0222c successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Temporary image 4326aaaf-97bf-45e6-8122-a4dcc022d063 for user 71b0e99d337a46408e0c644373a1282c is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Marking volume cc75ed4b-9900-4347-b19c-991d88a0222c as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Copying metadata from image 4326aaaf-97bf-45e6-8122-a4dcc022d063 to cc75ed4b-9900-4347-b19c-991d88a0222c. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Creating volume glance metadata for volume cc75ed4b-9900-4347-b19c-991d88a0222c backed by image 4326aaaf-97bf-45e6-8122-a4dcc022d063 with: {'image_id': '4326aaaf-97bf-45e6-8122-a4dcc022d063', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2b0d34fd3f90aac974294f7db9f08174', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4633298e-865e-4bd2-a79b-745dae042fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc75ed4b-9900-4347-b19c-991d88a0222c', 'volume_size': 1, 'image_id': '4326aaaf-97bf-45e6-8122-a4dcc022d063', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4326aaaf-97bf-45e6-8122-a4dcc022d063', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b0d34fd3f90aac974294f7db9f08174', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c2a5335d9c394cdb94605b222ee30617', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2a424608f7b02f3beca560689ca7f0d0aa94a4b97156bb1e56c1c43167583c83b9244b8fb2c1a797a2c398dbfefc03252b39658ccc89a4a915077d610da6414', 'id': '4326aaaf-97bf-45e6-8122-a4dcc022d063', 'created_at': datetime.datetime(2026, 11, 2, 9, 16, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 16, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4326aaaf-97bf-45e6-8122-a4dcc022d063/file', 'properties': {}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c20136-bd2f-4bc2-a524-9aa2b4593e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:51 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Volume volume-cc75ed4b-9900-4347-b19c-991d88a0222c (cc75ed4b-9900-4347-b19c-991d88a0222c): created successfully Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c20136-bd2f-4bc2-a524-9aa2b4593e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Flow 'volume_create_manager' (bdcd7ba7-2521-4dcd-b2d8-bf87469bf926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:51 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-83423d16-a46d-4018-8727-b7f5556f3272 tempest-VolumeImageDependencyTests-1601488891 None] Created volume successfully. Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Flow 'volume_create_manager' (b728313a-f101-454e-b9da-6fd594e9f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed15cb6-1a1b-4411-822b-acd5b610c8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed15cb6-1a1b-4411-822b-acd5b610c8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-601607142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20cca3b-9051-4d2d-8bed-16f1a8a6df49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d2f0beeba544ae949828a5adca900e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:52Z,use_quota=True,user_id='598dc2e2d1e6420db1dbf30144172859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccb1170-0b80-4c85-90da-48ff40db5c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccb1170-0b80-4c85-90da-48ff40db5c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66acb594-085b-4b2b-9696-f9ebb247b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66acb594-085b-4b2b-9696-f9ebb247b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e20cca3b-9051-4d2d-8bed-16f1a8a6df49', 'volume_name': 'volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bf54a7-2d9a-46ae-a574-2f42dace6ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bf54a7-2d9a-46ae-a574-2f42dace6ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e176b5c4-4418-4714-a976-652c798db6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:51 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Volume e20cca3b-9051-4d2d-8bed-16f1a8a6df49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49', 'volume_size': 1} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-601607142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20cca3b-9051-4d2d-8bed-16f1a8a6df49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d2f0beeba544ae949828a5adca900e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:52Z,use_quota=True,user_id='598dc2e2d1e6420db1dbf30144172859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Creating volume e20cca3b-9051-4d2d-8bed-16f1a8a6df49 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:51 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:51 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 1073741824 Nov 02 10:16:51 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:52 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 1073741824" returned: 0 in 0.475s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:52 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 Nov 02 10:16:52 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Acquiring lock "cinder-cc75ed4b-9900-4347-b19c-991d88a0222c-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Lock "cinder-cc75ed4b-9900-4347-b19c-991d88a0222c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Acquiring lock "cinder-quobyte-cc75ed4b-9900-4347-b19c-991d88a0222c" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Lock "cinder-quobyte-cc75ed4b-9900-4347-b19c-991d88a0222c" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bd39ab-30c8-4b55-b39a-648fa2f0afa9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:52 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49" returned: 0 in 0.350s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e176b5c4-4418-4714-a976-652c798db6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831f368f-7653-44d2-a87a-3f540f722d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:52 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Volume volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 (e20cca3b-9051-4d2d-8bed-16f1a8a6df49): created successfully Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831f368f-7653-44d2-a87a-3f540f722d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Flow 'volume_create_manager' (b728313a-f101-454e-b9da-6fd594e9f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-789a612f-6082-4733-a201-03573716adf9 tempest-VolumesMetadataTest-1123034436 None] Created volume successfully. Nov 02 10:16:52 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c Nov 02 10:16:52 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:53 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c" returned: 0 in 0.437s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:53 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c Nov 02 10:16:53 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:53 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cc75ed4b-9900-4347-b19c-991d88a0222c" returned: 0 in 0.284s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Lock "cinder-quobyte-cc75ed4b-9900-4347-b19c-991d88a0222c" released by "delete_volume" :: held 0.793s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Created reservations ['151164fa-1b4b-403b-b7bc-03edc88810e2', 'c6f0efdb-0b54-4729-bc19-d0a1f07f67e5', '904d497d-dd1c-4686-ba20-f8d98703bc5e', '9ba9ec11-2ae5-406c-b05b-8140c2c2ad15'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:53 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:53 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:53 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.327s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:53 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Deleted volume successfully. Nov 02 10:16:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-32bedc47-b7aa-42d2-b840-ee7251597ed5 tempest-VolumeImageDependencyTests-1601488891 None] Lock "cinder-cc75ed4b-9900-4347-b19c-991d88a0222c-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Acquiring lock "cinder-e20cca3b-9051-4d2d-8bed-16f1a8a6df49-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Lock "cinder-e20cca3b-9051-4d2d-8bed-16f1a8a6df49-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Acquiring lock "cinder-quobyte-e20cca3b-9051-4d2d-8bed-16f1a8a6df49" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Lock "cinder-quobyte-e20cca3b-9051-4d2d-8bed-16f1a8a6df49" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef922e20-b380-4f88-ac96-c0cbad0dc637]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:54 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 Nov 02 10:16:54 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:55 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49" returned: 0 in 0.400s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:55 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49 Nov 02 10:16:55 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:55 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e20cca3b-9051-4d2d-8bed-16f1a8a6df49" returned: 0 in 0.307s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Lock "cinder-quobyte-e20cca3b-9051-4d2d-8bed-16f1a8a6df49" released by "delete_volume" :: held 0.756s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Created reservations ['cd0f2a28-3e96-4f76-ab4b-247a40bd91df', '4f4b1d86-0b22-41d1-a172-5e3976f2967c', 'e081380e-b78c-4c53-9d0e-e383177edbc0', 'cd0332e8-038c-4b25-88b6-8c749992a605'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:55 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:16:55 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:56 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.298s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:56 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:16:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Deleted volume successfully. Nov 02 10:16:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-09361a4c-9ba0-42d8-ae8e-56d63ebece73 tempest-VolumesMetadataTest-1123034436 None] Lock "cinder-e20cca3b-9051-4d2d-8bed-16f1a8a6df49-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Flow 'volume_create_manager' (1427e743-29e3-4de9-b993-48ee7a186451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0454b7d9-91b5-4b19-af20-d6f159492039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0454b7d9-91b5-4b19-af20-d6f159492039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723334359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4d2a82-a8af-4a10-8b2d-b7d71d3e6095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75012a98e2b54a23b89213c2d3cb919f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:58Z,use_quota=True,user_id='9b504b8120514bf882a1e0447bed6592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bee0d56-e1d4-458d-96e4-30f1d40e64da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bee0d56-e1d4-458d-96e4-30f1d40e64da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3317f58c-52f7-4283-b506-2308020fd499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3317f58c-52f7-4283-b506-2308020fd499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4d2a82-a8af-4a10-8b2d-b7d71d3e6095', 'volume_name': 'volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b62da4-e203-4bd7-849b-d06c99e8fdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b62da4-e203-4bd7-849b-d06c99e8fdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc94715-d4b3-4e0b-a225-ba795f953ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:58 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Volume da4d2a82-a8af-4a10-8b2d-b7d71d3e6095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095', 'volume_size': 1} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723334359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4d2a82-a8af-4a10-8b2d-b7d71d3e6095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75012a98e2b54a23b89213c2d3cb919f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:58Z,use_quota=True,user_id='9b504b8120514bf882a1e0447bed6592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Creating volume da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:16:58 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:58 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 1073741824 Nov 02 10:16:58 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:58 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 1073741824" returned: 0 in 0.459s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:58 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 Nov 02 10:16:58 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:58 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095" returned: 0 in 0.257s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc94715-d4b3-4e0b-a225-ba795f953ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:58 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18abbc7b-4173-4eb6-a2cb-467d2d1ce5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:16:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Volume volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 (da4d2a82-a8af-4a10-8b2d-b7d71d3e6095): created successfully Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18abbc7b-4173-4eb6-a2cb-467d2d1ce5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Flow 'volume_create_manager' (1427e743-29e3-4de9-b993-48ee7a186451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:16:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5fed003c-49bb-4e05-ba6b-f7f35c158040 tempest-ProjectReaderTests-1822268720 None] Created volume successfully. Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "cinder-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Lock "cinder-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "cinder-quobyte-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Lock "cinder-quobyte-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095" acquired by "delete_volume" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a194419-9493-4af6-9a30-a5241fbf257e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:16:59 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 Nov 02 10:16:59 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:16:59 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095" returned: 0 in 0.421s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:16:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:00 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095 Nov 02 10:17:00 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:00 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095" returned: 0 in 0.268s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Lock "cinder-quobyte-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095" released by "delete_volume" :: held 0.737s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Created reservations ['ee78e580-6a7d-4bcc-8e4e-96656646818f', '1b53b2fd-4d5b-496b-9788-76760d17ee52', '3028954b-386e-468a-b0df-942be14d3eb1', '46ff862d-e8ea-4f8f-a191-351a1d507114'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:00 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:00 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:00 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.263s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Deleted volume successfully. Nov 02 10:17:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cac8e459-0232-4b9c-b23c-60ef2beec9f0 tempest-ProjectReaderTests-1822268720 None] Lock "cinder-da4d2a82-a8af-4a10-8b2d-b7d71d3e6095-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Flow 'volume_create_manager' (7bf9dc6e-7d4a-4425-ad8b-ad422b68030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e20ef62-c9a7-4663-9eba-d407ac783983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e20ef62-c9a7-4663-9eba-d407ac783983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130436645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75012a98e2b54a23b89213c2d3cb919f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:01Z,use_quota=True,user_id='9b504b8120514bf882a1e0447bed6592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074e723a-cf16-46b7-825c-e2322bd65d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074e723a-cf16-46b7-825c-e2322bd65d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa3aa4b-865c-4204-b93f-95b38d8c349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa3aa4b-865c-4204-b93f-95b38d8c349c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a', 'volume_name': 'volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10b0da9-a6fa-4de2-8e13-4598cc09dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10b0da9-a6fa-4de2-8e13-4598cc09dba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b353e7e-35ae-420a-9bc3-8e3f2278a847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Volume 9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a', 'volume_size': 1} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130436645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75012a98e2b54a23b89213c2d3cb919f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:01Z,use_quota=True,user_id='9b504b8120514bf882a1e0447bed6592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Creating volume 9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:01 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:01 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a 1073741824 Nov 02 10:17:01 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:01 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Flow 'volume_create_manager' (8971bae3-256b-4b35-963a-b52465549a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bd29ef-9523-48e3-9e1a-29fd39bd0d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a 1073741824" returned: 0 in 0.553s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bd29ef-9523-48e3-9e1a-29fd39bd0d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-54619020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ac945a-556d-4bd1-96f2-4d9244d75080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d90aee2d442cbb2f36cb07eadfcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:02Z,use_quota=True,user_id='7fe556a182db4d6e8edba0e9340505f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e638db01-0bad-491b-9397-c48f978cd991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e638db01-0bad-491b-9397-c48f978cd991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3f93bb-682e-4b1e-acc4-2f3c16e062a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3f93bb-682e-4b1e-acc4-2f3c16e062a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02ac945a-556d-4bd1-96f2-4d9244d75080', 'volume_name': 'volume-02ac945a-556d-4bd1-96f2-4d9244d75080', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6126d07-328f-4d99-9f9f-3b471ee98785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6126d07-328f-4d99-9f9f-3b471ee98785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f85089-0b8e-4c43-b465-4644d9300f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:01 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Volume 02ac945a-556d-4bd1-96f2-4d9244d75080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02ac945a-556d-4bd1-96f2-4d9244d75080', 'volume_size': 1} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:01 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a Nov 02 10:17:01 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:02 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a" returned: 0 in 0.264s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-54619020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ac945a-556d-4bd1-96f2-4d9244d75080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d90aee2d442cbb2f36cb07eadfcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:02Z,use_quota=True,user_id='7fe556a182db4d6e8edba0e9340505f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Creating volume 02ac945a-556d-4bd1-96f2-4d9244d75080 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:02 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b353e7e-35ae-420a-9bc3-8e3f2278a847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:02 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080 1073741824 Nov 02 10:17:02 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be78943-4a46-4436-87f5-c6a05fef06dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Volume volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a (9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a): created successfully Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be78943-4a46-4436-87f5-c6a05fef06dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Flow 'volume_create_manager' (7bf9dc6e-7d4a-4425-ad8b-ad422b68030a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bb80807f-ebdc-4ccb-a20a-898be4c31a79 tempest-ProjectReaderTests-1822268720 None] Created volume successfully. Nov 02 10:17:02 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080 1073741824" returned: 0 in 0.437s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:02 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080 Nov 02 10:17:02 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:02 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080" returned: 0 in 0.250s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f85089-0b8e-4c43-b465-4644d9300f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ac945a-556d-4bd1-96f2-4d9244d75080', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a26247-88a5-4726-b968-1ed1128cbd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Volume volume-02ac945a-556d-4bd1-96f2-4d9244d75080 (02ac945a-556d-4bd1-96f2-4d9244d75080): created successfully Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a26247-88a5-4726-b968-1ed1128cbd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Flow 'volume_create_manager' (8971bae3-256b-4b35-963a-b52465549a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-44140dc7-0079-4d5d-8e70-eb7d16e54f05 tempest-VolumesTransfersTest-1645046038 None] Created volume successfully. Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "cinder-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Lock "cinder-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "cinder-quobyte-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Lock "cinder-quobyte-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a" acquired by "delete_volume" :: waited 0.013s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e029f7d-39c5-4e31-860b-d8cb6a3896c1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:03 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a Nov 02 10:17:03 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:03 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a" returned: 0 in 0.379s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:03 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a Nov 02 10:17:03 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:03 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a" returned: 0 in 0.263s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Lock "cinder-quobyte-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a" released by "delete_volume" :: held 0.679s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:03 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Created reservations ['0925ed65-36fe-4d1c-9a87-f25148d93608', '7199f8e5-af83-42bd-a66c-73830d6d2034', '0f5650b8-74a3-4a85-8e12-cba4a4167ac7', 'ec55bf23-dcd2-485e-8a17-c78a0c0f628d'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:04 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:04 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:04 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.345s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:04 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Deleted volume successfully. Nov 02 10:17:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-65be998b-4c2a-4a9d-81da-9e89d0eb8c45 tempest-ProjectReaderTests-1822268720 None] Lock "cinder-9e7ba1a9-3cfd-4ac8-95a9-c0eb7ba1030a-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a300f477-066b-46be-a1b6-8f61b62fcbdf tempest-VolumesTransfersTest-1904708041 None] Transfer volume completed successfully. Nov 02 10:17:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Acquiring lock "cinder-02ac945a-556d-4bd1-96f2-4d9244d75080-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Lock "cinder-02ac945a-556d-4bd1-96f2-4d9244d75080-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Acquiring lock "cinder-quobyte-02ac945a-556d-4bd1-96f2-4d9244d75080" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Lock "cinder-quobyte-02ac945a-556d-4bd1-96f2-4d9244d75080" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:05 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe6bfea-929d-4717-9f99-35fd4ce50f74]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:05 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080 Nov 02 10:17:05 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:05 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080" returned: 0 in 0.385s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:05 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080 Nov 02 10:17:05 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:06 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-02ac945a-556d-4bd1-96f2-4d9244d75080" returned: 0 in 0.275s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Lock "cinder-quobyte-02ac945a-556d-4bd1-96f2-4d9244d75080" released by "delete_volume" :: held 0.706s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Created reservations ['e8c97ddc-b54a-4c19-bae7-ec7e6f0cde0b', '9ca34958-f12d-4285-b0a8-cea92da9c187', '4f26c9b6-e656-441b-8f36-7d731a77a4c5', '37f4e22e-bcf6-4b32-9724-c4a016d927cb'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:06 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:06 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:06 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.309s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Deleted volume successfully. Nov 02 10:17:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-dfaa76ee-4f03-4a9f-9827-588c1a4552a0 tempest-VolumesTransfersTest-17751172 None] Lock "cinder-02ac945a-556d-4bd1-96f2-4d9244d75080-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Flow 'volume_create_manager' (df913ed6-ef10-4401-a462-b2f0e62fbe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f431f18-3817-48e7-82c4-fac5543b4f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f431f18-3817-48e7-82c4-fac5543b4f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1625649983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186ba54f-8d01-4581-ba64-82388ed7b4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d90aee2d442cbb2f36cb07eadfcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:07Z,use_quota=True,user_id='7fe556a182db4d6e8edba0e9340505f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ffd1f65-59be-457e-baba-ba611757fe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ffd1f65-59be-457e-baba-ba611757fe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbb853e-89c5-4786-beac-f20882391efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dbb853e-89c5-4786-beac-f20882391efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186ba54f-8d01-4581-ba64-82388ed7b4e4', 'volume_name': 'volume-186ba54f-8d01-4581-ba64-82388ed7b4e4', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875d0e3f-066a-40c5-972e-cb5294b71e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875d0e3f-066a-40c5-972e-cb5294b71e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23953461-af35-469b-a943-daee8a377339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Volume 186ba54f-8d01-4581-ba64-82388ed7b4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186ba54f-8d01-4581-ba64-82388ed7b4e4', 'volume_size': 1} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1625649983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186ba54f-8d01-4581-ba64-82388ed7b4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0d90aee2d442cbb2f36cb07eadfcc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:07Z,use_quota=True,user_id='7fe556a182db4d6e8edba0e9340505f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Creating volume 186ba54f-8d01-4581-ba64-82388ed7b4e4 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:07 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:07 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 1073741824 Nov 02 10:17:07 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:07 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 1073741824" returned: 0 in 0.503s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:07 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 Nov 02 10:17:07 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:08 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4" returned: 0 in 0.253s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23953461-af35-469b-a943-daee8a377339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186ba54f-8d01-4581-ba64-82388ed7b4e4', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23b657d-60ab-4ca6-8a7c-7d976814bc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Volume volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 (186ba54f-8d01-4581-ba64-82388ed7b4e4): created successfully Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23b657d-60ab-4ca6-8a7c-7d976814bc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Flow 'volume_create_manager' (df913ed6-ef10-4401-a462-b2f0e62fbe2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-08bac28d-1c8d-4f15-bf07-7d5ea993dd0e tempest-VolumesTransfersTest-1645046038 None] Created volume successfully. Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Flow 'volume_create_manager' (17a36211-cf4a-4f38-8092-1bb44d4d87d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7e30c6-63fb-4dfe-a9fe-98330bbfe343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7e30c6-63fb-4dfe-a9fe-98330bbfe343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-434872290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e2148f-abcb-42fe-8613-b430eba6c13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5603ae117e34909955a78a2849c86e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:09Z,use_quota=True,user_id='052d6c8126c64114b1a99db3b3a161c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c83cda-2fc7-443f-b908-bbd2ef554b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c83cda-2fc7-443f-b908-bbd2ef554b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508398fa-54e0-419e-b463-2031de129fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508398fa-54e0-419e-b463-2031de129fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e2148f-abcb-42fe-8613-b430eba6c13b', 'volume_name': 'volume-06e2148f-abcb-42fe-8613-b430eba6c13b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8535004-591e-4644-b11b-5e80dbdda297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8535004-591e-4644-b11b-5e80dbdda297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83473596-27e3-4666-8ae8-07cd51a23f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Volume 06e2148f-abcb-42fe-8613-b430eba6c13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e2148f-abcb-42fe-8613-b430eba6c13b', 'volume_size': 1} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-434872290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e2148f-abcb-42fe-8613-b430eba6c13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5603ae117e34909955a78a2849c86e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:09Z,use_quota=True,user_id='052d6c8126c64114b1a99db3b3a161c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Creating volume 06e2148f-abcb-42fe-8613-b430eba6c13b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:08 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:08 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b 1073741824 Nov 02 10:17:08 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:09 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b 1073741824" returned: 0 in 0.500s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:09 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b Nov 02 10:17:09 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Acquiring lock "cinder-186ba54f-8d01-4581-ba64-82388ed7b4e4-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Lock "cinder-186ba54f-8d01-4581-ba64-82388ed7b4e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Acquiring lock "cinder-quobyte-186ba54f-8d01-4581-ba64-82388ed7b4e4" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Lock "cinder-quobyte-186ba54f-8d01-4581-ba64-82388ed7b4e4" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7669a84a-04b7-41f5-a387-8bdcefd1e304]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:09 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b" returned: 0 in 0.349s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83473596-27e3-4666-8ae8-07cd51a23f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e2148f-abcb-42fe-8613-b430eba6c13b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41aeb6a2-634f-4863-81f3-1aea485a032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:09 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Volume volume-06e2148f-abcb-42fe-8613-b430eba6c13b (06e2148f-abcb-42fe-8613-b430eba6c13b): created successfully Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41aeb6a2-634f-4863-81f3-1aea485a032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:09 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 Nov 02 10:17:09 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Flow 'volume_create_manager' (17a36211-cf4a-4f38-8092-1bb44d4d87d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-755c95e8-8b0e-477e-b47a-24ede17dc38d tempest-ProjectReaderTests-1145773085 None] Created volume successfully. Nov 02 10:17:10 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4" returned: 0 in 0.447s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:10 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4 Nov 02 10:17:10 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:10 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-186ba54f-8d01-4581-ba64-82388ed7b4e4" returned: 0 in 0.315s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Lock "cinder-quobyte-186ba54f-8d01-4581-ba64-82388ed7b4e4" released by "delete_volume" :: held 0.830s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Created reservations ['435802eb-1833-4e85-8a8e-9ee590d4e61c', '40352fca-6fb5-4b79-bacb-0ffe9407d690', '2a47d0cb-1f17-4c2e-8ac5-7174fe8274d2', '6deae2dc-05a8-45d8-8caf-f92faf078b90'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:10 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:10 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:10 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.336s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Deleted volume successfully. Nov 02 10:17:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64f5d74f-eb8b-4f40-9127-46bc1c53bd75 tempest-VolumesTransfersTest-17751172 None] Lock "cinder-186ba54f-8d01-4581-ba64-82388ed7b4e4-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "cinder-06e2148f-abcb-42fe-8613-b430eba6c13b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-06e2148f-abcb-42fe-8613-b430eba6c13b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "cinder-quobyte-06e2148f-abcb-42fe-8613-b430eba6c13b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-quobyte-06e2148f-abcb-42fe-8613-b430eba6c13b" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[352532aa-b11e-4027-ad03-d528bf3b4572]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:11 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b Nov 02 10:17:11 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:11 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b" returned: 0 in 0.434s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:11 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b Nov 02 10:17:11 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:11 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-06e2148f-abcb-42fe-8613-b430eba6c13b" returned: 0 in 0.274s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-quobyte-06e2148f-abcb-42fe-8613-b430eba6c13b" released by "delete_volume" :: held 0.765s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:11 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Created reservations ['1b1a6aed-5e01-474d-afff-357c3c96c2b8', '12ae89cd-42b0-4cb3-8ea9-5945244dc308', 'f85c03ab-5e6f-445e-bebd-7429c4685790', 'd950ce7c-7190-4812-9245-f00277ef4e6f'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:12 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:12 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:12 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.366s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:12 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Deleted volume successfully. Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5c91950f-30f4-4e56-aac9-d15f8ea9ece5 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-06e2148f-abcb-42fe-8613-b430eba6c13b-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Flow 'volume_create_manager' (f77ff5cc-9524-4345-8099-b8274fa9ff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe515772-90b0-430a-889d-c5363811bd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe515772-90b0-430a-889d-c5363811bd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407061201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dae2b9b-65cc-48a2-88a4-4fef70d19e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5603ae117e34909955a78a2849c86e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:13Z,use_quota=True,user_id='052d6c8126c64114b1a99db3b3a161c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2509a4d6-655b-4d61-84ed-c6b44bc1ebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2509a4d6-655b-4d61-84ed-c6b44bc1ebd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e846e98c-9a2f-4502-9b54-3716a346a554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e846e98c-9a2f-4502-9b54-3716a346a554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dae2b9b-65cc-48a2-88a4-4fef70d19e23', 'volume_name': 'volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06aa21c-c7a8-4d1b-98b5-ff48797c67eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06aa21c-c7a8-4d1b-98b5-ff48797c67eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e2d291-3a1c-408c-bda5-c96a1ff2bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:12 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Volume 8dae2b9b-65cc-48a2-88a4-4fef70d19e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23', 'volume_size': 1} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-407061201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dae2b9b-65cc-48a2-88a4-4fef70d19e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5603ae117e34909955a78a2849c86e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:13Z,use_quota=True,user_id='052d6c8126c64114b1a99db3b3a161c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Creating volume 8dae2b9b-65cc-48a2-88a4-4fef70d19e23 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:12 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:12 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 1073741824 Nov 02 10:17:12 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:13 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 1073741824" returned: 0 in 0.548s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:13 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 Nov 02 10:17:13 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:13 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23" returned: 0 in 0.295s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e2d291-3a1c-408c-bda5-c96a1ff2bd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed927efb-0a83-428a-a126-c33a0e47a10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:13 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Volume volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 (8dae2b9b-65cc-48a2-88a4-4fef70d19e23): created successfully Nov 02 10:17:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed927efb-0a83-428a-a126-c33a0e47a10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Flow 'volume_create_manager' (f77ff5cc-9524-4345-8099-b8274fa9ff65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:13 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cac24c98-bd7e-4183-8fab-6a0c3c9dc968 tempest-ProjectReaderTests-1145773085 None] Created volume successfully. Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "cinder-8dae2b9b-65cc-48a2-88a4-4fef70d19e23-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-8dae2b9b-65cc-48a2-88a4-4fef70d19e23-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "cinder-quobyte-8dae2b9b-65cc-48a2-88a4-4fef70d19e23" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-quobyte-8dae2b9b-65cc-48a2-88a4-4fef70d19e23" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[907ef827-e0f7-4e53-b3ea-ff33158b0d19]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:15 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 Nov 02 10:17:15 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:15 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23" returned: 0 in 0.478s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:15 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23 Nov 02 10:17:15 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:15 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8dae2b9b-65cc-48a2-88a4-4fef70d19e23" returned: 0 in 0.308s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-quobyte-8dae2b9b-65cc-48a2-88a4-4fef70d19e23" released by "delete_volume" :: held 0.842s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:15 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Created reservations ['d7a74908-f114-4a75-b1a5-13b1ac5b63ed', 'adca2f7a-f078-4390-a543-63bca946928e', '1b7a4713-8f48-4b98-a73b-067583d2d342', 'c479b65c-f2f8-4a38-b419-61c320a1319e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:16 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:16 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:16 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.379s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:16 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Deleted volume successfully. Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-769dc29b-ae57-4579-a7bb-03be82ffbd74 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-8dae2b9b-65cc-48a2-88a4-4fef70d19e23-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Flow 'volume_create_manager' (49a014da-98ec-4e9f-8267-96a0576e4d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66426f3-ad9c-4ebc-b0c4-116649412ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66426f3-ad9c-4ebc-b0c4-116649412ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853004913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecbf58d-9640-4f89-ac76-eb46258650f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5603ae117e34909955a78a2849c86e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:17Z,use_quota=True,user_id='052d6c8126c64114b1a99db3b3a161c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad8a37b-925e-420d-93f7-1d3c0c89a8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad8a37b-925e-420d-93f7-1d3c0c89a8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48733065-26ca-4c53-a519-851d84836670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48733065-26ca-4c53-a519-851d84836670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecbf58d-9640-4f89-ac76-eb46258650f4', 'volume_name': 'volume-2ecbf58d-9640-4f89-ac76-eb46258650f4', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cbdd74-77dc-41e7-a7df-78c480d6374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cbdd74-77dc-41e7-a7df-78c480d6374c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed1fc74-d861-4cb4-8670-3dfb8ba6ad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:16 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Volume 2ecbf58d-9640-4f89-ac76-eb46258650f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecbf58d-9640-4f89-ac76-eb46258650f4', 'volume_size': 1} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853004913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecbf58d-9640-4f89-ac76-eb46258650f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5603ae117e34909955a78a2849c86e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:17Z,use_quota=True,user_id='052d6c8126c64114b1a99db3b3a161c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Creating volume 2ecbf58d-9640-4f89-ac76-eb46258650f4 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:16 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:16 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 1073741824 Nov 02 10:17:16 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:17 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 1073741824" returned: 0 in 0.530s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:17 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 Nov 02 10:17:17 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:17 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4" returned: 0 in 0.311s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed1fc74-d861-4cb4-8670-3dfb8ba6ad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecbf58d-9640-4f89-ac76-eb46258650f4', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822f2449-71a4-410f-854a-db4ebb2dac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:17 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Volume volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 (2ecbf58d-9640-4f89-ac76-eb46258650f4): created successfully Nov 02 10:17:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822f2449-71a4-410f-854a-db4ebb2dac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Flow 'volume_create_manager' (49a014da-98ec-4e9f-8267-96a0576e4d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-747e61b6-e9bd-47c5-9b62-1725f3684587 tempest-ProjectReaderTests-1145773085 None] Created volume successfully. Nov 02 10:17:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "cinder-2ecbf58d-9640-4f89-ac76-eb46258650f4-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:18 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-2ecbf58d-9640-4f89-ac76-eb46258650f4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "cinder-quobyte-2ecbf58d-9640-4f89-ac76-eb46258650f4" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-quobyte-2ecbf58d-9640-4f89-ac76-eb46258650f4" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df6f6d3-dcac-4072-8a03-f702f08272a3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:19 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 Nov 02 10:17:19 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:19 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4" returned: 0 in 0.428s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:19 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4 Nov 02 10:17:19 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:19 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2ecbf58d-9640-4f89-ac76-eb46258650f4" returned: 0 in 0.323s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-quobyte-2ecbf58d-9640-4f89-ac76-eb46258650f4" released by "delete_volume" :: held 0.810s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Flow 'volume_create_manager' (bba0eaf5-5431-42e0-81c2-68f8dd7a898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ed2f99-1238-4d4a-b4a9-6b5729970d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:19 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Created reservations ['18fba1a7-4b92-456e-9891-cd9760dac811', '199f17d8-643b-4c04-ba02-8de119d4b29f', 'a47ecca8-71ab-457c-a59f-56ab48976eb5', '2d0fcd72-98d8-43df-b580-9913b5b0e978'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ed2f99-1238-4d4a-b4a9-6b5729970d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1473932689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc794cf2-df3e-4045-bf8a-9319d6439d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ee3f93478647fea992085cf35c36b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:20Z,use_quota=True,user_id='1ec8416531f6444bb46ca23726407614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb42c85-fc3f-40be-b2a8-f23fb41c76a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb42c85-fc3f-40be-b2a8-f23fb41c76a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637d3aa2-5166-4a49-a593-994dbf8007e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637d3aa2-5166-4a49-a593-994dbf8007e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc794cf2-df3e-4045-bf8a-9319d6439d7e', 'volume_name': 'volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242fd52c-0362-4911-b2d6-23171797adbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242fd52c-0362-4911-b2d6-23171797adbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c13e22-8fe6-4ad8-9a63-a5c43b419df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:20 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Volume dc794cf2-df3e-4045-bf8a-9319d6439d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e', 'volume_size': 1} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1473932689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc794cf2-df3e-4045-bf8a-9319d6439d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ee3f93478647fea992085cf35c36b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:20Z,use_quota=True,user_id='1ec8416531f6444bb46ca23726407614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Creating volume dc794cf2-df3e-4045-bf8a-9319d6439d7e {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:20 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:20 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e 1073741824 Nov 02 10:17:20 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:20 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:20 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:20 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.272s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:20 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Deleted volume successfully. Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-85d6a16f-9dfb-4c0f-b1b6-2320981581c7 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-2ecbf58d-9640-4f89-ac76-eb46258650f4-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:20 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e 1073741824" returned: 0 in 0.520s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:20 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e Nov 02 10:17:20 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:20 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:20 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:20 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e" returned: 0 in 0.285s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c13e22-8fe6-4ad8-9a63-a5c43b419df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f474c91f-fa3e-4b55-a6e7-472c113ffd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:20 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Volume volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e (dc794cf2-df3e-4045-bf8a-9319d6439d7e): created successfully Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f474c91f-fa3e-4b55-a6e7-472c113ffd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:20 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Flow 'volume_create_manager' (bba0eaf5-5431-42e0-81c2-68f8dd7a898c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:20 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a8af7807-3719-45db-aa3d-0c4e3f9e586b tempest-VolumesTransfersV357Test-1698570171 None] Created volume successfully. Nov 02 10:17:21 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.270s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Flow 'volume_create_manager' (19cffb22-aff0-4de1-aba9-0e8386f42d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3252b771-3aca-4b12-8467-c1eabed7f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3252b771-3aca-4b12-8467-c1eabed7f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744984926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80a7e98-0ab0-469b-ace1-fa522c1f3d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5603ae117e34909955a78a2849c86e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:22Z,use_quota=True,user_id='052d6c8126c64114b1a99db3b3a161c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdf3243-f881-481f-bfcc-46c11a08ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdf3243-f881-481f-bfcc-46c11a08ad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb7726a-8f0c-4496-bd65-40b43179c00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb7726a-8f0c-4496-bd65-40b43179c00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80a7e98-0ab0-469b-ace1-fa522c1f3d40', 'volume_name': 'volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dfb2c8-46f1-4552-a5c4-6706095da784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dfb2c8-46f1-4552-a5c4-6706095da784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc702f-0fde-4b15-b978-2c732870ced4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Volume c80a7e98-0ab0-469b-ace1-fa522c1f3d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40', 'volume_size': 1} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744984926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80a7e98-0ab0-469b-ace1-fa522c1f3d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5603ae117e34909955a78a2849c86e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:22Z,use_quota=True,user_id='052d6c8126c64114b1a99db3b3a161c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Creating volume c80a7e98-0ab0-469b-ace1-fa522c1f3d40 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:21 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:21 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 1073741824 Nov 02 10:17:21 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:22 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 1073741824" returned: 0 in 0.463s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:22 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 Nov 02 10:17:22 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:22 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40" returned: 0 in 0.283s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fc702f-0fde-4b15-b978-2c732870ced4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17836a46-c23f-47fd-a3d9-3fed73112db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:22 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-703a3cf1-222c-459e-947c-e6bd2d738094 tempest-VolumesTransfersV357Test-966804181 None] Transfer volume completed successfully. Nov 02 10:17:22 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Volume volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 (c80a7e98-0ab0-469b-ace1-fa522c1f3d40): created successfully Nov 02 10:17:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17836a46-c23f-47fd-a3d9-3fed73112db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Flow 'volume_create_manager' (19cffb22-aff0-4de1-aba9-0e8386f42d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:22 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4f5438a6-f26d-4745-86e1-1a252083eb3a tempest-ProjectReaderTests-1145773085 None] Created volume successfully. Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Acquiring lock "cinder-dc794cf2-df3e-4045-bf8a-9319d6439d7e-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Lock "cinder-dc794cf2-df3e-4045-bf8a-9319d6439d7e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Acquiring lock "cinder-quobyte-dc794cf2-df3e-4045-bf8a-9319d6439d7e" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Lock "cinder-quobyte-dc794cf2-df3e-4045-bf8a-9319d6439d7e" acquired by "delete_volume" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa078aec-18d7-44e2-b769-e0678241e641]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:23 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e Nov 02 10:17:23 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:23 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e" returned: 0 in 0.355s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:23 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e Nov 02 10:17:23 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "cinder-c80a7e98-0ab0-469b-ace1-fa522c1f3d40-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-c80a7e98-0ab0-469b-ace1-fa522c1f3d40-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "cinder-quobyte-c80a7e98-0ab0-469b-ace1-fa522c1f3d40" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:23 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-dc794cf2-df3e-4045-bf8a-9319d6439d7e" returned: 0 in 0.273s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Lock "cinder-quobyte-dc794cf2-df3e-4045-bf8a-9319d6439d7e" released by "delete_volume" :: held 0.673s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-quobyte-c80a7e98-0ab0-469b-ace1-fa522c1f3d40" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97e5952-4348-45a0-9e91-38d320166700]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:23 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Created reservations ['8ad21772-50f8-4c76-b6ef-94d7f7251127', 'd40e0ea2-8214-472b-a2dc-223817143ab0', '542cdfbb-7b4e-4064-85a7-9ebec6467f97', 'a9ac69c6-caf3-48b8-a0f5-d7b879771c4e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:24 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 Nov 02 10:17:24 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:24 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:24 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:24 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.272s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:24 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Deleted volume successfully. Nov 02 10:17:24 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40" returned: 0 in 0.432s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0564eef7-1571-4e19-8cd4-78ed6af04044 tempest-VolumesTransfersV357Test-277326871 None] Lock "cinder-dc794cf2-df3e-4045-bf8a-9319d6439d7e-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:24 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40 Nov 02 10:17:24 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:24 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c80a7e98-0ab0-469b-ace1-fa522c1f3d40" returned: 0 in 0.283s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-quobyte-c80a7e98-0ab0-469b-ace1-fa522c1f3d40" released by "delete_volume" :: held 0.760s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Created reservations ['e0dceef0-b755-4f31-bc9a-ada3c467a902', 'f5ee1c4a-f938-4016-8e5f-6796ce4c69b9', 'a23f9792-0280-44f3-ab24-cd75fe419e40', '717d35f8-f807-49ac-b97c-cc075d8396fe'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:24 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:24 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Flow 'volume_create_manager' (3c9fb93d-d8f3-4d09-8665-936819aba1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60536d6-942c-475e-a7c3-86ae6d5f6e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60536d6-942c-475e-a7c3-86ae6d5f6e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1977365813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c375f21f-8240-4e5e-b8f3-57597df19a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ee3f93478647fea992085cf35c36b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:25Z,use_quota=True,user_id='1ec8416531f6444bb46ca23726407614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d62040-8587-4db8-8814-ec58232e3d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d62040-8587-4db8-8814-ec58232e3d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd15f66b-91e6-4c98-a453-3726fefd4dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd15f66b-91e6-4c98-a453-3726fefd4dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c375f21f-8240-4e5e-b8f3-57597df19a0a', 'volume_name': 'volume-c375f21f-8240-4e5e-b8f3-57597df19a0a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7625e209-7b30-48d8-b455-2073848879fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7625e209-7b30-48d8-b455-2073848879fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57074f84-d05c-438b-a88e-84d407fa3a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:25 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Volume c375f21f-8240-4e5e-b8f3-57597df19a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c375f21f-8240-4e5e-b8f3-57597df19a0a', 'volume_size': 1} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1977365813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c375f21f-8240-4e5e-b8f3-57597df19a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ee3f93478647fea992085cf35c36b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:25Z,use_quota=True,user_id='1ec8416531f6444bb46ca23726407614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Creating volume c375f21f-8240-4e5e-b8f3-57597df19a0a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:25 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:25 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a 1073741824 Nov 02 10:17:25 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:25 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.335s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Deleted volume successfully. Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6b19a5e3-dcca-4d8e-ae12-ad4ec75fd276 tempest-ProjectReaderTests-1145773085 None] Lock "cinder-c80a7e98-0ab0-469b-ace1-fa522c1f3d40-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:25 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a 1073741824" returned: 0 in 0.519s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:25 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a Nov 02 10:17:25 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:26 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a" returned: 0 in 0.275s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57074f84-d05c-438b-a88e-84d407fa3a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c375f21f-8240-4e5e-b8f3-57597df19a0a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1338747b-323a-4e29-a7ea-6bb2ef3ebab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:26 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Volume volume-c375f21f-8240-4e5e-b8f3-57597df19a0a (c375f21f-8240-4e5e-b8f3-57597df19a0a): created successfully Nov 02 10:17:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1338747b-323a-4e29-a7ea-6bb2ef3ebab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Flow 'volume_create_manager' (3c9fb93d-d8f3-4d09-8665-936819aba1d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1bf47ad6-812d-4e8b-872f-d335180b40b7 tempest-VolumesTransfersV357Test-1698570171 None] Created volume successfully. Nov 02 10:17:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Acquiring lock "cinder-c375f21f-8240-4e5e-b8f3-57597df19a0a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Lock "cinder-c375f21f-8240-4e5e-b8f3-57597df19a0a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:27 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=146,cinder:INSERT=64,cinder:UPDATE=208,cinder:DELETE=16 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:17:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Acquiring lock "cinder-quobyte-c375f21f-8240-4e5e-b8f3-57597df19a0a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Lock "cinder-quobyte-c375f21f-8240-4e5e-b8f3-57597df19a0a" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:27 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea7f7ac-2ee8-4ae5-b55c-ffb1d7b73157]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:27 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a Nov 02 10:17:27 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:27 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a" returned: 0 in 0.418s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:27 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a Nov 02 10:17:27 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:28 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c375f21f-8240-4e5e-b8f3-57597df19a0a" returned: 0 in 0.294s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Lock "cinder-quobyte-c375f21f-8240-4e5e-b8f3-57597df19a0a" released by "delete_volume" :: held 0.768s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Created reservations ['9ea1055d-25c5-489a-ba32-08e21501bf44', '8df7b17c-c75d-42cb-b7f1-72c2cd71eaec', 'e3c6325f-d433-4ac5-81fc-7b71a60b4ec2', '231fa791-5c27-4ccd-bdc1-44e86ba8f9db'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:28 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:17:28 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:28 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.281s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:17:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Deleted volume successfully. Nov 02 10:17:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f52a8e51-6655-4e48-bf54-04911af8d6c4 tempest-VolumesTransfersV357Test-277326871 None] Lock "cinder-c375f21f-8240-4e5e-b8f3-57597df19a0a-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:17:38 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:17:38 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:INSERT=47,cinder:UPDATE=202,cinder:SELECT=141,cinder:DELETE=16 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Flow 'volume_create_manager' (fff7836b-4344-460e-94e8-ae3519905e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b06413-fda3-480f-b238-b2f55a676271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b06413-fda3-480f-b238-b2f55a676271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1863748733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba383e66-ae1a-4c84-b817-5c82efeb9e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a7746dc1a4a9b948a1458b3d0c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:48Z,use_quota=True,user_id='df8f6116346e4e07bed362bd72cb750d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2faa6bc3-c482-471d-95cc-ee4ae634f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2faa6bc3-c482-471d-95cc-ee4ae634f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dec3067-4284-4ea7-b8a1-528f5aa21040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dec3067-4284-4ea7-b8a1-528f5aa21040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba383e66-ae1a-4c84-b817-5c82efeb9e10', 'volume_name': 'volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6a8d0a-df16-4ed4-867d-270014187322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6a8d0a-df16-4ed4-867d-270014187322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29525d6-7e4a-4fe8-9d1c-fed5892008ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Volume ba383e66-ae1a-4c84-b817-5c82efeb9e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10', 'volume_size': 1} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1863748733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba383e66-ae1a-4c84-b817-5c82efeb9e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a7746dc1a4a9b948a1458b3d0c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:48Z,use_quota=True,user_id='df8f6116346e4e07bed362bd72cb750d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Creating volume ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:47 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:48 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 1073741824 Nov 02 10:17:48 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:48 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 1073741824" returned: 0 in 0.498s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:48 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 Nov 02 10:17:48 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:48 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10" returned: 0 in 0.256s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29525d6-7e4a-4fe8-9d1c-fed5892008ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fa15c3-9fb3-4648-a8ae-7393278e0496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:48 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Volume volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 (ba383e66-ae1a-4c84-b817-5c82efeb9e10): created successfully Nov 02 10:17:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fa15c3-9fb3-4648-a8ae-7393278e0496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Flow 'volume_create_manager' (fff7836b-4344-460e-94e8-ae3519905e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6ed0b1c7-03b7-4a92-8476-6e5256dbeaba tempest-SnapshotDependencyTests-480864505 None] Created volume successfully. Nov 02 10:17:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Creating offline snapshot b7a07ac0-3b0b-4c1b-b531-35b2ce47194f of volume ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:17:50 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[329dc89d-0803-4eed-b83c-8339657b4aa8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:50 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 Nov 02 10:17:50 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:50 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10" returned: 0 in 0.412s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:50 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f 1G Nov 02 10:17:50 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:51 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f 1G" returned: 0 in 0.538s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:51 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f Nov 02 10:17:51 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:51 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f" returned: 0 in 0.402s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:51 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f is being set with open permissions: ugo+rw Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:51 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f Nov 02 10:17:51 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:51 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Flow 'volume_create_manager' (bbc5c75a-fecf-42fc-8a51-403ca11ff9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0613338-f751-46be-a20e-6f4e6387546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f" returned: 0 in 0.340s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0613338-f751-46be-a20e-6f4e6387546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1098950623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d549c3d-7af2-4054-945c-3adaadbdd633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d78294f8644ee5b23159d60871ef5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:52Z,use_quota=True,user_id='ed5297501d8d423eab16f613ec9419b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8023e5b7-9e9c-49ed-9b6b-5b5fb1e3a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8023e5b7-9e9c-49ed-9b6b-5b5fb1e3a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d545e4c0-af6d-4c6f-80c3-553a5bbaee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d545e4c0-af6d-4c6f-80c3-553a5bbaee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d549c3d-7af2-4054-945c-3adaadbdd633', 'volume_name': 'volume-1d549c3d-7af2-4054-945c-3adaadbdd633', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4d5544-62a6-4bc3-9930-4e5d46a122ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4d5544-62a6-4bc3-9930-4e5d46a122ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc86f87-0816-498c-ba81-487d45e7bac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:52 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Volume 1d549c3d-7af2-4054-945c-3adaadbdd633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d549c3d-7af2-4054-945c-3adaadbdd633', 'volume_size': 1} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:52 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.info Nov 02 10:17:52 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:52 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.info" returned: 0 in 0.275s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:52 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.info is being set with open permissions: ugo+rw Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:52 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.info Nov 02 10:17:52 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:52 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.info" returned: 0 in 0.256s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1098950623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d549c3d-7af2-4054-945c-3adaadbdd633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d78294f8644ee5b23159d60871ef5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:52Z,use_quota=True,user_id='ed5297501d8d423eab16f613ec9419b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Creating volume 1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:52 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:17:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:52 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 1073741824 Nov 02 10:17:52 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-84ee4f8a-f974-45c9-ac58-a9f56bb19183 tempest-SnapshotDependencyTests-480864505 None] Create snapshot completed successfully Nov 02 10:17:53 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 1073741824" returned: 0 in 0.433s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:53 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 Nov 02 10:17:53 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:53 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633" returned: 0 in 0.262s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:17:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:53 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc86f87-0816-498c-ba81-487d45e7bac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d549c3d-7af2-4054-945c-3adaadbdd633', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:53 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8e424c-50cc-4ded-9292-2dddf1ae0354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:53 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Volume volume-1d549c3d-7af2-4054-945c-3adaadbdd633 (1d549c3d-7af2-4054-945c-3adaadbdd633): created successfully Nov 02 10:17:53 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8e424c-50cc-4ded-9292-2dddf1ae0354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:53 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Flow 'volume_create_manager' (bbc5c75a-fecf-42fc-8a51-403ca11ff9ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:53 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-9fc6b141-accd-4fb9-a2fe-55a7fc170b3b tempest-VolumesActionsTest-2087481403 None] Created volume successfully. Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Flow 'volume_create_manager' (75e6fe16-648d-441f-90a7-830188d033fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ed54b5-42f4-40f5-989e-2e7676e523d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ed54b5-42f4-40f5-989e-2e7676e523d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d0f866-bf1d-4653-98e1-5c34a850e166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6a7746dc1a4a9b948a1458b3d0c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b7a07ac0-3b0b-4c1b-b531-35b2ce47194f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:54Z,use_quota=True,user_id='df8f6116346e4e07bed362bd72cb750d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d2c403-671e-467c-8d17-774536c8f307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d2c403-671e-467c-8d17-774536c8f307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a78155b-d69a-4828-ac3b-ce1c01faae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a78155b-d69a-4828-ac3b-ce1c01faae58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8d0f866-bf1d-4653-98e1-5c34a850e166', 'volume_name': 'volume-f8d0f866-bf1d-4653-98e1-5c34a850e166', 'volume_size': 1, 'snapshot_id': 'b7a07ac0-3b0b-4c1b-b531-35b2ce47194f'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7717b29c-acb4-44c9-9526-ea0fa4a555e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7717b29c-acb4-44c9-9526-ea0fa4a555e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f15e88b-ea66-4b58-96c3-39e4c975479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:17:54 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Volume f8d0f866-bf1d-4653-98e1-5c34a850e166: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8d0f866-bf1d-4653-98e1-5c34a850e166', 'volume_size': 1, 'snapshot_id': 'b7a07ac0-3b0b-4c1b-b531-35b2ce47194f'} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "cinder-quobyte-b7a07ac0-3b0b-4c1b-b531-35b2ce47194f-f8d0f866-bf1d-4653-98e1-5c34a850e166" by "_create_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-b7a07ac0-3b0b-4c1b-b531-35b2ce47194f-f8d0f866-bf1d-4653-98e1-5c34a850e166" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Creating volume f8d0f866-bf1d-4653-98e1-5c34a850e166 from snapshot b7a07ac0-3b0b-4c1b-b531-35b2ce47194f {{(pid=86840) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "cinder-quobyte-f8d0f866-bf1d-4653-98e1-5c34a850e166" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-f8d0f866-bf1d-4653-98e1-5c34a850e166" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] snapshot: b7a07ac0-3b0b-4c1b-b531-35b2ce47194f, volume: f8d0f866-bf1d-4653-98e1-5c34a850e166, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d49de-ec61-411d-90b9-ad1b2842052c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:54 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f Nov 02 10:17:54 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:54 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f" returned: 0 in 0.397s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d0c4c5-3b4f-4519-ab28-6ac55519f904]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:17:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:54 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 Nov 02 10:17:54 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:17:55 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Nov 02 10:17:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10" returned: 0 in 0.439s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:17:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:17:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:17:55 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:17:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:17:55 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 Nov 02 10:17:55 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:03 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166" returned: 0 in 8.368s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10, size 1024.00 MB, duration 8.37 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:18:03 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Converted 1024.00 MB image at 122.36 MB/s Nov 02 10:18:03 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 is being set with open permissions: ugo+rw Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:03 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 Nov 02 10:18:03 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:03 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166" returned: 0 in 0.255s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-f8d0f866-bf1d-4653-98e1-5c34a850e166" released by "_copy_volume_from_snapshot" :: held 9.560s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-b7a07ac0-3b0b-4c1b-b531-35b2ce47194f-f8d0f866-bf1d-4653-98e1-5c34a850e166" released by "_create_volume_from_snapshot" :: held 9.637s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.659s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f15e88b-ea66-4b58-96c3-39e4c975479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d0f866-bf1d-4653-98e1-5c34a850e166', 'volume_size': 1, 'snapshot_id': 'b7a07ac0-3b0b-4c1b-b531-35b2ce47194f'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771fdf8d-3171-40e6-ae2a-da995040df60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:18:03 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Volume volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 (f8d0f866-bf1d-4653-98e1-5c34a850e166): created successfully Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771fdf8d-3171-40e6-ae2a-da995040df60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:18:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Flow 'volume_create_manager' (75e6fe16-648d-441f-90a7-830188d033fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:18:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c6e2b157-d8c1-423e-89d1-e393fca35e7e tempest-SnapshotDependencyTests-480864505 None] Created volume successfully. Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3e9c2b42-80c6-40c1-b6bc-f3aad6abaf34 tempest-VolumesActionsTest-2087481403 None] Acquiring lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633" by "attach_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3e9c2b42-80c6-40c1-b6bc-f3aad6abaf34 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633" acquired by "attach_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3e9c2b42-80c6-40c1-b6bc-f3aad6abaf34 tempest-VolumesActionsTest-2087481403 None] Attaching volume 1d549c3d-7af2-4054-945c-3adaadbdd633 to instance 724f30af-4823-4892-9b81-1deb6342c649 at mountpoint /dev/vdb on host None. Nov 02 10:18:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3e9c2b42-80c6-40c1-b6bc-f3aad6abaf34 tempest-VolumesActionsTest-2087481403 None] Attach volume completed successfully. Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3e9c2b42-80c6-40c1-b6bc-f3aad6abaf34 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633" released by "attach_volume" :: held 0.129s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "cinder-b7a07ac0-3b0b-4c1b-b531-35b2ce47194f-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-b7a07ac0-3b0b-4c1b-b531-35b2ce47194f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "cinder-quobyte-ba383e66-ae1a-4c84-b817-5c82efeb9e10" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-ba383e66-ae1a-4c84-b817-5c82efeb9e10" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "cinder-quobyte-b7a07ac0-3b0b-4c1b-b531-35b2ce47194f" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-b7a07ac0-3b0b-4c1b-b531-35b2ce47194f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Deleting offline snapshot b7a07ac0-3b0b-4c1b-b531-35b2ce47194f of volume ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] snapshot_file for this snap is: volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b05e7d2-6243-4987-8888-69ea632ed815]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cff3f5b4-a6c8-4deb-a03a-70365f536de1 tempest-VolumesActionsTest-2087481403 None] Acquiring lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633-detach_volume" by "detach_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cff3f5b4-a6c8-4deb-a03a-70365f536de1 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cff3f5b4-a6c8-4deb-a03a-70365f536de1 tempest-VolumesActionsTest-2087481403 None] Detaching volume 1d549c3d-7af2-4054-945c-3adaadbdd633 from instance 724f30af-4823-4892-9b81-1deb6342c649. Nov 02 10:18:04 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f Nov 02 10:18:04 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cff3f5b4-a6c8-4deb-a03a-70365f536de1 tempest-VolumesActionsTest-2087481403 None] Detach volume completed successfully. Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-cff3f5b4-a6c8-4deb-a03a-70365f536de1 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:04 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f" returned: 0 in 0.492s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:18:05 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bed114-9ae0-4820-b29e-c11d3911d160]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:05 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 Nov 02 10:18:05 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:05 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10" returned: 0 in 0.682s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:05 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f Nov 02 10:18:05 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:06 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:06 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f Nov 02 10:18:06 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:06 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10.b7a07ac0-3b0b-4c1b-b531-35b2ce47194f" returned: 0 in 0.294s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-b7a07ac0-3b0b-4c1b-b531-35b2ce47194f" released by "_delete_snapshot" :: held 2.054s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-ba383e66-ae1a-4c84-b817-5c82efeb9e10" released by "delete_snapshot" :: held 2.089s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:06 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Created reservations ['65050976-e21a-4011-92fa-c88655e8dfa8', 'fb7c1d08-615b-4939-a3c2-fa211af104a1', '9e478436-3c85-47f3-a8d8-1ad3714de63d', '9e0dcb3e-8170-42cf-9063-61fb64b60813'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Delete snapshot completed successfully. Nov 02 10:18:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-608e1692-e2f2-48d2-832a-7064ce81a30d tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-b7a07ac0-3b0b-4c1b-b531-35b2ce47194f-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "cinder-ba383e66-ae1a-4c84-b817-5c82efeb9e10-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-ba383e66-ae1a-4c84-b817-5c82efeb9e10-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "cinder-quobyte-ba383e66-ae1a-4c84-b817-5c82efeb9e10" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-ba383e66-ae1a-4c84-b817-5c82efeb9e10" acquired by "delete_volume" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:07 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d404c2-7abc-4f47-b8ce-b1cbe2148328]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:07 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 Nov 02 10:18:07 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:08 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10" returned: 0 in 0.394s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:08 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10 Nov 02 10:18:08 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:08 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-ba383e66-ae1a-4c84-b817-5c82efeb9e10" returned: 0 in 0.282s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-ba383e66-ae1a-4c84-b817-5c82efeb9e10" released by "delete_volume" :: held 0.754s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Created reservations ['6fd0469c-a5df-4ffa-86a8-13f526970aed', 'ce018517-8f55-4f27-b397-64b607d3aa97', '3c6d8d9c-0c9d-4173-adae-a212b1b3fdc2', 'a8de80fa-f88c-480c-bab6-eb92b925c66c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:08 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:18:08 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "cinder-f8d0f866-bf1d-4653-98e1-5c34a850e166-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-f8d0f866-bf1d-4653-98e1-5c34a850e166-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "cinder-quobyte-f8d0f866-bf1d-4653-98e1-5c34a850e166" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-f8d0f866-bf1d-4653-98e1-5c34a850e166" acquired by "delete_volume" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:08 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.295s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Deleted volume successfully. Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5ff23e-f7b5-4fa3-9297-7a995c3892f4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-23557371-46a4-47e9-9cef-aa338d3caf68 tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-ba383e66-ae1a-4c84-b817-5c82efeb9e10-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:08 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 Nov 02 10:18:08 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:09 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166" returned: 0 in 0.393s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:09 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166 Nov 02 10:18:09 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:09 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f8d0f866-bf1d-4653-98e1-5c34a850e166" returned: 0 in 0.311s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-quobyte-f8d0f866-bf1d-4653-98e1-5c34a850e166" released by "delete_volume" :: held 0.762s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Created reservations ['4c0615fc-f0fd-4071-b504-a3a8d5c5ab0d', '416a8a01-9d87-4b53-a7b2-e2863a9568d5', 'a77e871d-2744-4783-9b4c-e4b8b0412c9b', 'c34bae82-45e2-4bcd-803f-07b15bc79811'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:09 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:18:09 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:09 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.259s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:10 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Deleted volume successfully. Nov 02 10:18:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-339a7898-3d03-44ac-9b06-345d4637754e tempest-SnapshotDependencyTests-480864505 None] Lock "cinder-f8d0f866-bf1d-4653-98e1-5c34a850e166-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7fd49105-8e6d-447f-ac51-6bff426aeeb8 tempest-VolumesActionsTest-2087481403 None] Acquiring lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633" by "attach_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7fd49105-8e6d-447f-ac51-6bff426aeeb8 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633" acquired by "attach_volume" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:14 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7fd49105-8e6d-447f-ac51-6bff426aeeb8 tempest-VolumesActionsTest-2087481403 None] Attaching volume 1d549c3d-7af2-4054-945c-3adaadbdd633 to instance 4bc4de69-3da5-4913-b8ff-2bbbe5f423f3 at mountpoint /dev/vdb on host None. Nov 02 10:18:14 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7fd49105-8e6d-447f-ac51-6bff426aeeb8 tempest-VolumesActionsTest-2087481403 None] Attach volume completed successfully. Nov 02 10:18:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7fd49105-8e6d-447f-ac51-6bff426aeeb8 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633" released by "attach_volume" :: held 0.109s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-edf42640-1ac3-4bc7-b919-b122e82dd4bb tempest-VolumesActionsTest-2087481403 None] Acquiring lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633-detach_volume" by "detach_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-edf42640-1ac3-4bc7-b919-b122e82dd4bb tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:14 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-edf42640-1ac3-4bc7-b919-b122e82dd4bb tempest-VolumesActionsTest-2087481403 None] Detaching volume 1d549c3d-7af2-4054-945c-3adaadbdd633 from instance 4bc4de69-3da5-4913-b8ff-2bbbe5f423f3. Nov 02 10:18:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-edf42640-1ac3-4bc7-b919-b122e82dd4bb tempest-VolumesActionsTest-2087481403 None] Detach volume completed successfully. Nov 02 10:18:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-edf42640-1ac3-4bc7-b919-b122e82dd4bb tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:19 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59860c3-594c-4788-8505-2b8746a578f3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:19 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 Nov 02 10:18:19 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:20 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633" returned: 0 in 0.395s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf766b1-157c-49c2-98aa-5825a8021015]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:20 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 Nov 02 10:18:20 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:20 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633" returned: 0 in 0.385s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.90f11d88-50db-4ae4-af1d-472f1f8a0a38ssness6_.img {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:20 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.90f11d88-50db-4ae4-af1d-472f1f8a0a38ssness6_.img Nov 02 10:18:20 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:20 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:18:20 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:21 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.362s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:18:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:18:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:18:25 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=39,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:18:27 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.90f11d88-50db-4ae4-af1d-472f1f8a0a38ssness6_.img" returned: 0 in 6.348s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:27 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d0f04e-c7b9-46df-bb11-ee34f2f14ae3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:27 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 Nov 02 10:18:27 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:27 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633" returned: 0 in 0.545s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:27 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.90f11d88-50db-4ae4-af1d-472f1f8a0a38ssness6_.img {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:18:27 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Converted 1024.00 MB image at 161.29 MB/s Nov 02 10:18:27 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] 90f11d88-50db-4ae4-af1d-472f1f8a0a38 was raw, no need to convert to raw {{(pid=86840) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 10:18:29 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=41,cinder:SELECT=42,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:18:37 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=2 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:18:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.257s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Uploaded volume to glance image-id: 90f11d88-50db-4ae4-af1d-472f1f8a0a38. {{(pid=86840) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:18:46 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1e11fbbe-50df-46fe-a018-a321ef21847d tempest-VolumesActionsTest-2087481403 None] Copy volume to image completed successfully. Nov 02 10:18:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:47 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aab4873-4acd-41e0-a961-9ec07ec71c20]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:47 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 Nov 02 10:18:47 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:48 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633" returned: 0 in 0.387s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1a0fe9-994b-47b0-bbdd-d1365d914a50]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:48 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 Nov 02 10:18:48 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:48 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633" returned: 0 in 0.387s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:48 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img Nov 02 10:18:48 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:54 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img" returned: 0 in 5.652s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c76a2a8-3707-42e2-99c1-c6d73b279253]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:54 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 Nov 02 10:18:54 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:54 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633" returned: 0 in 0.524s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:54 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:18:54 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Converted 1024.00 MB image at 181.10 MB/s Nov 02 10:18:54 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] 479447cc-7ea8-492f-8e67-4542df97b63a was raw, converting to qcow2 {{(pid=86840) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 10:18:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a86845-a1a5-4927-af06-4d102da5d6c8]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:54 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img Nov 02 10:18:54 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:55 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img" returned: 0 in 0.320s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:55 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img Nov 02 10:18:55 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:55 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img" returned: 1 in 0.300s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img /opt/stack/data/cinder/conversion/vol_upload_fjzqqj8g {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:55 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img /opt/stack/data/cinder/conversion/vol_upload_fjzqqj8g Nov 02 10:18:55 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:55 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img /opt/stack/data/cinder/conversion/vol_upload_fjzqqj8g" returned: 0 in 0.247s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Image conversion details: src /opt/stack/data/cinder/conversion/1d549c3d-7af2-4054-945c-3adaadbdd633.temp_image.479447cc-7ea8-492f-8e67-4542df97b63auc42u9lf.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fjzqqj8g {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:18:55 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b92b59-c263-4c7b-8f78-4f79e540efca]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fjzqqj8g {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:55 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fjzqqj8g Nov 02 10:18:55 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:55 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fjzqqj8g" returned: 0 in 0.309s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.434s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Uploaded volume to glance image-id: 479447cc-7ea8-492f-8e67-4542df97b63a. {{(pid=86840) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:18:57 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b77b2e7a-18fa-496e-8a95-6f0992eeb4ea tempest-VolumesActionsTest-2087481403 None] Copy volume to image completed successfully. Nov 02 10:18:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Acquiring lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Acquiring lock "cinder-quobyte-1d549c3d-7af2-4054-945c-3adaadbdd633" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:18:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-quobyte-1d549c3d-7af2-4054-945c-3adaadbdd633" acquired by "delete_volume" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:18:58 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8911c63a-ceec-4249-81d9-f41ee4d87dab]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:18:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:59 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 Nov 02 10:18:59 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:59 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633" returned: 0 in 0.346s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:59 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633 Nov 02 10:18:59 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:59 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1d549c3d-7af2-4054-945c-3adaadbdd633" returned: 0 in 0.255s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-quobyte-1d549c3d-7af2-4054-945c-3adaadbdd633" released by "delete_volume" :: held 0.645s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Created reservations ['5eb6e4d8-da00-4b33-b67c-f244deeba2d7', '5149c838-3993-464f-b5c9-6113d59354c8', 'd0fcce78-1dbf-4690-b415-759ec5e95090', 'aa966425-560d-4875-9919-c356079bbf3e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:18:59 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:18:59 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:18:59 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.242s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:18:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Deleted volume successfully. Nov 02 10:18:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b16f95ca-fa72-4b38-be1a-099322cbdc16 tempest-VolumesActionsTest-2087481403 None] Lock "cinder-1d549c3d-7af2-4054-945c-3adaadbdd633-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Flow 'volume_create_manager' (74af6333-1bb9-466d-ad4b-183aa702d088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a126a5-1038-4a77-9e75-74f300db4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a126a5-1038-4a77-9e75-74f300db4011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-545865910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8707ca47-4f84-4fac-8829-02b8b7d4a93d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11000422ce03402a941b894317df3b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:07Z,use_quota=True,user_id='93b2b5adf47848069b79716cf145810f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bce57c6-6d36-4acc-bb32-006fc4de9c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bce57c6-6d36-4acc-bb32-006fc4de9c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194fac19-c5c0-4bb0-8758-56117e61a7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194fac19-c5c0-4bb0-8758-56117e61a7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8707ca47-4f84-4fac-8829-02b8b7d4a93d', 'volume_name': 'volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d2e19a-da30-4708-bbb9-cac64f91c534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d2e19a-da30-4708-bbb9-cac64f91c534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fbb469-8491-46ce-a74b-9c4e889eaaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Volume 8707ca47-4f84-4fac-8829-02b8b7d4a93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d', 'volume_size': 1} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-545865910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8707ca47-4f84-4fac-8829-02b8b7d4a93d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11000422ce03402a941b894317df3b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:07Z,use_quota=True,user_id='93b2b5adf47848069b79716cf145810f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Creating volume 8707ca47-4f84-4fac-8829-02b8b7d4a93d {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:07 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:07 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d 1073741824 Nov 02 10:19:07 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:07 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d 1073741824" returned: 0 in 0.452s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:07 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d Nov 02 10:19:07 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:08 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d" returned: 0 in 0.253s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fbb469-8491-46ce-a74b-9c4e889eaaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e41bc53-a2b8-47a9-b633-0323276ff86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Volume volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d (8707ca47-4f84-4fac-8829-02b8b7d4a93d): created successfully Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e41bc53-a2b8-47a9-b633-0323276ff86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Flow 'volume_create_manager' (74af6333-1bb9-466d-ad4b-183aa702d088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f35548f3-cea5-4f30-be42-9437e2ae7bce tempest-VolumesListTestJSON-1421920055 None] Created volume successfully. Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Flow 'volume_create_manager' (b141cd73-f897-4475-9027-36c0990a2cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840f0113-6405-4157-b6f3-c80ca24e5ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840f0113-6405-4157-b6f3-c80ca24e5ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-101636571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1923d1e1-5f3e-437d-baa1-1ee928cb8625,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11000422ce03402a941b894317df3b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:09Z,use_quota=True,user_id='93b2b5adf47848069b79716cf145810f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bdf866-b9b9-4ff2-abe3-6e5074c8c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bdf866-b9b9-4ff2-abe3-6e5074c8c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104488f1-e0e4-4ebb-8e84-fac80077ab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104488f1-e0e4-4ebb-8e84-fac80077ab2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1923d1e1-5f3e-437d-baa1-1ee928cb8625', 'volume_name': 'volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca6ef94-49cb-4cab-80de-fa5376fad841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca6ef94-49cb-4cab-80de-fa5376fad841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5a48ce-5486-40c5-b22a-2897ed696ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Volume 1923d1e1-5f3e-437d-baa1-1ee928cb8625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625', 'volume_size': 1} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-101636571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1923d1e1-5f3e-437d-baa1-1ee928cb8625,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11000422ce03402a941b894317df3b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:09Z,use_quota=True,user_id='93b2b5adf47848069b79716cf145810f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Creating volume 1923d1e1-5f3e-437d-baa1-1ee928cb8625 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:08 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:19:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:08 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 1073741824 Nov 02 10:19:08 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:09 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 1073741824" returned: 0 in 0.413s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:09 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 Nov 02 10:19:09 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:09 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625" returned: 0 in 0.240s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5a48ce-5486-40c5-b22a-2897ed696ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d347b0d9-b5b3-41b6-852e-b2fa3a1f51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:09 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Volume volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 (1923d1e1-5f3e-437d-baa1-1ee928cb8625): created successfully Nov 02 10:19:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d347b0d9-b5b3-41b6-852e-b2fa3a1f51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Flow 'volume_create_manager' (b141cd73-f897-4475-9027-36c0990a2cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-622c57e3-25de-47de-bc6d-266bd7b19a4f tempest-VolumesListTestJSON-1421920055 None] Created volume successfully. Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Flow 'volume_create_manager' (d8eccd33-5c4b-4e61-a358-affc76e45c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4830ec7-ad92-45a2-8498-489f2a009cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4830ec7-ad92-45a2-8498-489f2a009cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1351772059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1840d067-9620-4050-8fbb-8727faba36ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11000422ce03402a941b894317df3b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:10Z,use_quota=True,user_id='93b2b5adf47848069b79716cf145810f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f213fcc-e683-462f-b77b-e5fbd2d6d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f213fcc-e683-462f-b77b-e5fbd2d6d568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94d2373-b067-4e14-b950-357b185056e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94d2373-b067-4e14-b950-357b185056e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1840d067-9620-4050-8fbb-8727faba36ef', 'volume_name': 'volume-1840d067-9620-4050-8fbb-8727faba36ef', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1463ca-623a-4fe1-a5ed-25daa1d48a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1463ca-623a-4fe1-a5ed-25daa1d48a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ff8e51-a2bc-4777-b945-f01bde8194a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:10 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Volume 1840d067-9620-4050-8fbb-8727faba36ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1840d067-9620-4050-8fbb-8727faba36ef', 'volume_size': 1} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1351772059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1840d067-9620-4050-8fbb-8727faba36ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11000422ce03402a941b894317df3b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:10Z,use_quota=True,user_id='93b2b5adf47848069b79716cf145810f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Creating volume 1840d067-9620-4050-8fbb-8727faba36ef {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:10 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:10 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef 1073741824 Nov 02 10:19:10 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:10 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef 1073741824" returned: 0 in 0.410s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:10 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef Nov 02 10:19:10 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:11 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef" returned: 0 in 0.242s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ff8e51-a2bc-4777-b945-f01bde8194a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1840d067-9620-4050-8fbb-8727faba36ef', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a950d252-fcc7-4803-ad01-ab117140c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:11 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Volume volume-1840d067-9620-4050-8fbb-8727faba36ef (1840d067-9620-4050-8fbb-8727faba36ef): created successfully Nov 02 10:19:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a950d252-fcc7-4803-ad01-ab117140c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:11 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Flow 'volume_create_manager' (d8eccd33-5c4b-4e61-a358-affc76e45c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:11 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-de948bb7-c97b-4f3a-9819-4991185af0fc tempest-VolumesListTestJSON-1421920055 None] Created volume successfully. Nov 02 10:19:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "cinder-1840d067-9620-4050-8fbb-8727faba36ef-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-1840d067-9620-4050-8fbb-8727faba36ef-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "cinder-quobyte-1840d067-9620-4050-8fbb-8727faba36ef" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-quobyte-1840d067-9620-4050-8fbb-8727faba36ef" acquired by "delete_volume" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:13 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b4d854-dd55-45e3-b01e-39ed464c0063]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:13 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef Nov 02 10:19:13 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:14 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef" returned: 0 in 0.355s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:14 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef Nov 02 10:19:14 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:14 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1840d067-9620-4050-8fbb-8727faba36ef" returned: 0 in 0.346s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-quobyte-1840d067-9620-4050-8fbb-8727faba36ef" released by "delete_volume" :: held 0.749s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Created reservations ['4ad8cd20-9cf1-457a-8fb8-a672aa34add9', 'd775de64-8bcb-427d-a6ae-d947df62e227', '5d38310f-ec98-4ab8-aa69-8284cc49d036', 'c207b4f1-27e8-4360-8679-f027ae67d98c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:14 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:19:14 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:14 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.307s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:14 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Deleted volume successfully. Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "cinder-1923d1e1-5f3e-437d-baa1-1ee928cb8625-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-1923d1e1-5f3e-437d-baa1-1ee928cb8625-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-17f63d7f-aece-4c62-aa8f-8b83ceb5343b tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-1840d067-9620-4050-8fbb-8727faba36ef-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "cinder-quobyte-1923d1e1-5f3e-437d-baa1-1ee928cb8625" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-quobyte-1923d1e1-5f3e-437d-baa1-1ee928cb8625" acquired by "delete_volume" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b43ee6f-1f5f-4317-abe6-b8ef78004c3f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:15 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 Nov 02 10:19:15 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:15 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625" returned: 0 in 0.395s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:15 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625 Nov 02 10:19:15 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:15 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1923d1e1-5f3e-437d-baa1-1ee928cb8625" returned: 0 in 0.251s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-quobyte-1923d1e1-5f3e-437d-baa1-1ee928cb8625" released by "delete_volume" :: held 0.690s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Created reservations ['213ba4b3-cd5c-40f8-942d-64e8871dfd6a', 'a45d8113-5e47-49bd-bf1b-35d1f4a35aef', 'bb07a7a9-a506-42da-8d9f-418a8377b422', 'f80cc464-76ae-4bd8-a548-092f89280c8c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:15 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:19:15 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:16 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.273s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:16 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Deleted volume successfully. Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6feb2dbf-183b-40f5-92db-27bb4c83ae48 tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-1923d1e1-5f3e-437d-baa1-1ee928cb8625-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "cinder-8707ca47-4f84-4fac-8829-02b8b7d4a93d-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-8707ca47-4f84-4fac-8829-02b8b7d4a93d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "cinder-quobyte-8707ca47-4f84-4fac-8829-02b8b7d4a93d" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-quobyte-8707ca47-4f84-4fac-8829-02b8b7d4a93d" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5d54f7-e05e-4fb9-a484-0698bb69ab36]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:16 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d Nov 02 10:19:16 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:16 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d" returned: 0 in 0.356s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:16 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d Nov 02 10:19:16 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:16 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8707ca47-4f84-4fac-8829-02b8b7d4a93d" returned: 0 in 0.244s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-quobyte-8707ca47-4f84-4fac-8829-02b8b7d4a93d" released by "delete_volume" :: held 0.657s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Created reservations ['ef367b1e-514c-42d0-ab5c-c72b5aee9f6d', 'f6ae03fd-8439-481e-ae7c-4150caa3445d', '03139a76-3917-49e3-85e4-d1abf461bca9', '5d2f8f37-a9f3-4728-9ab8-69e7972a4ec3'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:16 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:19:16 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:17 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.266s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:17 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Deleted volume successfully. Nov 02 10:19:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6ccf2d15-e662-4883-9890-2b42a1776782 tempest-VolumesListTestJSON-1421920055 None] Lock "cinder-8707ca47-4f84-4fac-8829-02b8b7d4a93d-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:19:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:20 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:19:20 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Flow 'volume_create_manager' (28f66767-7eae-4737-9bba-b0bafaa1822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023c6ff5-01d1-4bad-8bf2-e24cd282a15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023c6ff5-01d1-4bad-8bf2-e24cd282a15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1800095993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7590b78-6002-405e-b28c-638247632624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b4072cc330445b9ec07a267b745d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:21Z,use_quota=True,user_id='a6cbe1240b8142878c7d352413522c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d8d283-2d31-402a-88f7-d9104d21aee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d8d283-2d31-402a-88f7-d9104d21aee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db25b4b4-20cc-48a9-a45e-178e4e3dee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db25b4b4-20cc-48a9-a45e-178e4e3dee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7590b78-6002-405e-b28c-638247632624', 'volume_name': 'volume-e7590b78-6002-405e-b28c-638247632624', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b80679b-4f04-4f27-bb6c-cb750e08105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b80679b-4f04-4f27-bb6c-cb750e08105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d171bf4-9b95-406f-a3cd-3702a043e74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Volume e7590b78-6002-405e-b28c-638247632624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7590b78-6002-405e-b28c-638247632624', 'volume_size': 1} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1800095993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7590b78-6002-405e-b28c-638247632624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b4072cc330445b9ec07a267b745d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:21Z,use_quota=True,user_id='a6cbe1240b8142878c7d352413522c6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Creating volume e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:21 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.374s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:19:21 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 1073741824 Nov 02 10:19:21 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:21 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 1073741824" returned: 0 in 0.445s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:21 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 Nov 02 10:19:21 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:21 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624" returned: 0 in 0.235s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d171bf4-9b95-406f-a3cd-3702a043e74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7590b78-6002-405e-b28c-638247632624', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5382d6e7-73cc-43cd-9b7f-7d1c192bbb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Volume volume-e7590b78-6002-405e-b28c-638247632624 (e7590b78-6002-405e-b28c-638247632624): created successfully Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5382d6e7-73cc-43cd-9b7f-7d1c192bbb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Flow 'volume_create_manager' (28f66767-7eae-4737-9bba-b0bafaa1822f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:21 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-32ac901e-3004-4378-8c33-c2c03f483d31 tempest-VolumesSnapshotListTestJSON-1307151220 None] Created volume successfully. Nov 02 10:19:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Creating offline snapshot 9965c897-189c-4b10-9a17-fe28cc212fce of volume e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:19:22 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d854d9-a482-4592-a7c9-5f4b17a42913]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:22 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 Nov 02 10:19:22 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:22 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624" returned: 0 in 0.340s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:22 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce 1G Nov 02 10:19:22 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:22 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce 1G" returned: 0 in 0.382s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7590b78-6002-405e-b28c-638247632624 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:22 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7590b78-6002-405e-b28c-638247632624 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce Nov 02 10:19:22 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:23 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7590b78-6002-405e-b28c-638247632624 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce" returned: 0 in 0.305s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:23 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce is being set with open permissions: ugo+rw Nov 02 10:19:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:23 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce Nov 02 10:19:23 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:23 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce" returned: 0 in 0.255s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:23 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.info Nov 02 10:19:23 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:23 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.info" returned: 0 in 0.253s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:23 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.info is being set with open permissions: ugo+rw Nov 02 10:19:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:23 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.info Nov 02 10:19:23 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:24 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.info" returned: 0 in 0.254s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:24 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3800f480-30fc-4765-93fd-818bcc773f40 tempest-VolumesSnapshotListTestJSON-1307151220 None] Create snapshot completed successfully Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Creating offline snapshot 61b47842-8f44-40ba-8e1d-3d351ccfcc17 of volume e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c05882-048f-4cce-bf57-85b48d590f85]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:24 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce Nov 02 10:19:24 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:24 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce" returned: 0 in 0.403s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7590b78-6002-405e-b28c-638247632624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:24 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 1G Nov 02 10:19:24 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:25 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 1G" returned: 0 in 0.460s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:25 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 Nov 02 10:19:25 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:25 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17" returned: 0 in 0.301s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:25 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 is being set with open permissions: ugo+rw Nov 02 10:19:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:25 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 Nov 02 10:19:25 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:25 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17" returned: 0 in 0.238s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.514s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1cf18913-6d71-4139-b82e-9b42cf127142 tempest-VolumesSnapshotListTestJSON-1307151220 None] Create snapshot completed successfully Nov 02 10:19:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Creating offline snapshot 16c13f49-4d8c-48f5-9316-269c63aff7a4 of volume e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:19:26 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b36abe-8dc0-4637-b0f5-19b20fbc8f33]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:27 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 Nov 02 10:19:27 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:27 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17" returned: 0 in 0.439s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7590b78-6002-405e-b28c-638247632624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:27 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 1G Nov 02 10:19:27 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:27 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 1G" returned: 0 in 0.472s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:27 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 Nov 02 10:19:27 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:28 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4" returned: 0 in 0.278s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:28 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 is being set with open permissions: ugo+rw Nov 02 10:19:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:28 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 Nov 02 10:19:28 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:28 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4" returned: 0 in 0.235s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.543s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d55c80f1-529d-410e-9885-5eb683e9f1ca tempest-VolumesSnapshotListTestJSON-1307151220 None] Create snapshot completed successfully Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-16c13f49-4d8c-48f5-9316-269c63aff7a4-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-16c13f49-4d8c-48f5-9316-269c63aff7a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-quobyte-16c13f49-4d8c-48f5-9316-269c63aff7a4" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-16c13f49-4d8c-48f5-9316-269c63aff7a4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Deleting offline snapshot 16c13f49-4d8c-48f5-9316-269c63aff7a4 of volume e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] snapshot_file for this snap is: volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ecc9c9-b763-43e0-959f-576f66a3f5c0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:29 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 Nov 02 10:19:29 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:30 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4" returned: 0 in 0.347s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7590b78-6002-405e-b28c-638247632624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:30 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[736fb788-f078-4eef-83fe-44a4ef59ce8e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:30 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 Nov 02 10:19:30 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:30 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17" returned: 0 in 0.381s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7590b78-6002-405e-b28c-638247632624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:30 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 Nov 02 10:19:30 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:30 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4" returned: 0 in 0.401s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:30 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4 Nov 02 10:19:30 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:31 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.16c13f49-4d8c-48f5-9316-269c63aff7a4" returned: 0 in 0.249s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-16c13f49-4d8c-48f5-9316-269c63aff7a4" released by "_delete_snapshot" :: held 1.469s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" released by "delete_snapshot" :: held 1.492s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Created reservations ['8b4e1485-c5c3-4f1e-8e9a-72dc1579babc', '5abe5e63-15cd-40d9-9995-2a6262a8e0a8', '22b3f32f-cab2-49f5-b3fc-73024fc2b244', '8aa0e0c7-66e4-4eb3-bd9c-ca4b120a46bb'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Delete snapshot completed successfully. Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b59eefde-6270-4d17-bd3b-e2fef13fff2c tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-16c13f49-4d8c-48f5-9316-269c63aff7a4-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-61b47842-8f44-40ba-8e1d-3d351ccfcc17-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-61b47842-8f44-40ba-8e1d-3d351ccfcc17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-quobyte-61b47842-8f44-40ba-8e1d-3d351ccfcc17" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-61b47842-8f44-40ba-8e1d-3d351ccfcc17" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Deleting offline snapshot 61b47842-8f44-40ba-8e1d-3d351ccfcc17 of volume e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] snapshot_file for this snap is: volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8e6360-ec58-4e58-9700-5dff89c5e6dc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:32 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 Nov 02 10:19:32 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:32 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17" returned: 0 in 0.378s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7590b78-6002-405e-b28c-638247632624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:32 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefa0d7a-403d-4fa9-b669-a66aaec2b603]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:32 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce Nov 02 10:19:32 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:32 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce" returned: 0 in 0.366s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7590b78-6002-405e-b28c-638247632624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:32 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 Nov 02 10:19:32 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:33 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17" returned: 0 in 0.372s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:33 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17 Nov 02 10:19:33 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:33 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.61b47842-8f44-40ba-8e1d-3d351ccfcc17" returned: 0 in 0.245s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-61b47842-8f44-40ba-8e1d-3d351ccfcc17" released by "_delete_snapshot" :: held 1.454s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" released by "delete_snapshot" :: held 1.478s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:33 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Created reservations ['daf18e35-3fa0-4a89-9f44-31a51a4f1cc0', 'b09a1ead-8e7a-4ffd-a070-4c571c21ac6c', 'f530611f-f715-4283-b99b-9c3b9b02b11d', 'ce16dd08-1fe8-49bc-a3f0-8cd9faa2fb3c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Delete snapshot completed successfully. Nov 02 10:19:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a3821562-ac8f-4732-9a45-b2df3882f947 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-61b47842-8f44-40ba-8e1d-3d351ccfcc17-delete_snapshot" released by "delete_snapshot" :: held 1.618s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-9965c897-189c-4b10-9a17-fe28cc212fce-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-9965c897-189c-4b10-9a17-fe28cc212fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-quobyte-9965c897-189c-4b10-9a17-fe28cc212fce" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-9965c897-189c-4b10-9a17-fe28cc212fce" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Deleting offline snapshot 9965c897-189c-4b10-9a17-fe28cc212fce of volume e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] snapshot_file for this snap is: volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f105cca-4fd5-478e-a353-d7c6c1f8d7e5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:34 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce Nov 02 10:19:34 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:34 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce" returned: 0 in 0.366s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7590b78-6002-405e-b28c-638247632624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce804e6f-f540-433b-b488-d7bfd8dc39e0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:34 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 Nov 02 10:19:34 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:34 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624" returned: 0 in 0.373s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:34 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce Nov 02 10:19:34 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:35 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce" returned: 0 in 0.335s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:35 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce Nov 02 10:19:35 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:35 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624.9965c897-189c-4b10-9a17-fe28cc212fce" returned: 0 in 0.263s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-9965c897-189c-4b10-9a17-fe28cc212fce" released by "_delete_snapshot" :: held 1.454s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" released by "delete_snapshot" :: held 1.475s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:35 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Created reservations ['d4440b60-ef78-4d57-9a4d-f7d3cff2d884', '04ddb281-807a-416c-b28b-9e6e421c99e4', '0ed11a0d-6066-4314-80c4-3e0d66a49f32', 'd476f23c-6586-4542-b78c-9b7061d235f9'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:35 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Delete snapshot completed successfully. Nov 02 10:19:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d652d9f0-9f32-48ac-9c6b-6dd09e2c8398 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-9965c897-189c-4b10-9a17-fe28cc212fce-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-e7590b78-6002-405e-b28c-638247632624-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-e7590b78-6002-405e-b28c-638247632624-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1045b224-f305-4b32-8b35-a3458a39bbfd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:36 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 Nov 02 10:19:36 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:36 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624" returned: 0 in 0.357s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:36 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624 Nov 02 10:19:36 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:36 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e7590b78-6002-405e-b28c-638247632624" returned: 0 in 0.269s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-quobyte-e7590b78-6002-405e-b28c-638247632624" released by "delete_volume" :: held 0.693s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Created reservations ['10057871-872b-4f06-82f2-7a74cc12b956', 'f69497ce-e2f1-4def-b27c-7c5264a40927', 'fc7820c7-052f-4f43-8792-c4d5eff53d05', 'fc488d5c-ea14-4214-ac83-1b5778f060ef'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:37 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:19:37 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:37 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.271s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:37 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Deleted volume successfully. Nov 02 10:19:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d4b238f1-ac31-40ab-bea3-c8f57a558912 tempest-VolumesSnapshotListTestJSON-1307151220 None] Lock "cinder-e7590b78-6002-405e-b28c-638247632624-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=75,cinder:SELECT=62,cinder:INSERT=20,cinder:DELETE=8 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=56,cinder:UPDATE=72,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Flow 'volume_create_manager' (dcfa6ce6-bc04-4dd9-8859-adc8996d5ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec4313c-1b3e-452e-b6b3-2e00312b2f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec4313c-1b3e-452e-b6b3-2e00312b2f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326a7680-cbde-4d5b-823b-a3dfff91de78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cffc0a1aa6546c7968921b08cec383c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:44Z,use_quota=True,user_id='411eb2f9a9c74c0fb4b5e2c57d0abb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01fa9ec0-d70d-4bb1-92e0-be79adda2187),volume_type_id=01fa9ec0-d70d-4bb1-92e0-be79adda2187)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c41e25-53f2-4943-8ae8-e28326bfd496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c41e25-53f2-4943-8ae8-e28326bfd496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23a06f7-ea6e-4ac4-b84a-00cacb6a7de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23a06f7-ea6e-4ac4-b84a-00cacb6a7de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '326a7680-cbde-4d5b-823b-a3dfff91de78', 'volume_name': 'volume-326a7680-cbde-4d5b-823b-a3dfff91de78', 'volume_size': 1, 'image_id': '86947621-9c42-4716-8f36-2217367081e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86947621-9c42-4716-8f36-2217367081e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36c57a6435bbe5a9dc8acdc5490aec43', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cffc0a1aa6546c7968921b08cec383c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f310f3708970137c2156ac7dc24cf6b2b0b066d4c76f9f2b49c4ff1d2147fcf556636e06f7d029725fe601ad10a77781230c599067070fc4a1de88ef705d1d35', 'id': '86947621-9c42-4716-8f36-2217367081e4', 'created_at': datetime.datetime(2026, 11, 2, 9, 19, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 19, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86947621-9c42-4716-8f36-2217367081e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14701449-ec83-4109-ae15-b83d6739b9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14701449-ec83-4109-ae15-b83d6739b9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026f0402-0122-44fc-9250-8b1034140587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:43 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Volume 326a7680-cbde-4d5b-823b-a3dfff91de78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-326a7680-cbde-4d5b-823b-a3dfff91de78', 'volume_size': 1, 'image_id': '86947621-9c42-4716-8f36-2217367081e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86947621-9c42-4716-8f36-2217367081e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36c57a6435bbe5a9dc8acdc5490aec43', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cffc0a1aa6546c7968921b08cec383c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f310f3708970137c2156ac7dc24cf6b2b0b066d4c76f9f2b49c4ff1d2147fcf556636e06f7d029725fe601ad10a77781230c599067070fc4a1de88ef705d1d35', 'id': '86947621-9c42-4716-8f36-2217367081e4', 'created_at': datetime.datetime(2026, 11, 2, 9, 19, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 19, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86947621-9c42-4716-8f36-2217367081e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Trying to clone 326a7680-cbde-4d5b-823b-a3dfff91de78 from image 86947621-9c42-4716-8f36-2217367081e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/86947621-9c42-4716-8f36-2217367081e4', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:19:43 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:19:43 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:19:44 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[783a44f7-da0b-4f45-af29-66f7e1483222]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:44 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD Nov 02 10:19:44 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:44 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD" returned: 0 in 0.308s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:44 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD Nov 02 10:19:44 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:44 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:19:44 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Temporary image 86947621-9c42-4716-8f36-2217367081e4 is fetched for user 411eb2f9a9c74c0fb4b5e2c57d0abb09. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:19:44 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca368f5e-97c5-4397-9dfc-cede5aa4b757]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:44 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD Nov 02 10:19:44 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:45 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:45 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD Nov 02 10:19:45 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:45 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326a7680-cbde-4d5b-823b-a3dfff91de78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cffc0a1aa6546c7968921b08cec383c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:44Z,use_quota=True,user_id='411eb2f9a9c74c0fb4b5e2c57d0abb09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01fa9ec0-d70d-4bb1-92e0-be79adda2187),volume_type_id=01fa9ec0-d70d-4bb1-92e0-be79adda2187)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Creating volume 326a7680-cbde-4d5b-823b-a3dfff91de78 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:45 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:45 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 1073741824 Nov 02 10:19:45 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:45 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 1073741824" returned: 0 in 0.440s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:45 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 Nov 02 10:19:45 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:46 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78" returned: 0 in 0.248s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Attempting download of 86947621-9c42-4716-8f36-2217367081e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/86947621-9c42-4716-8f36-2217367081e4', 'metadata': {}}])) to volume 326a7680-cbde-4d5b-823b-a3dfff91de78. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[509812e1-9ea4-41b5-8227-da69b60d0154]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86947621-9c42-4716-8f36-2217367081e4_k4_u22s2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:46 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86947621-9c42-4716-8f36-2217367081e4_k4_u22s2 Nov 02 10:19:46 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:46 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86947621-9c42-4716-8f36-2217367081e4_k4_u22s2" returned: 0 in 0.314s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86947621-9c42-4716-8f36-2217367081e4_k4_u22s2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:46 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86947621-9c42-4716-8f36-2217367081e4_k4_u22s2 Nov 02 10:19:46 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:46 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86947621-9c42-4716-8f36-2217367081e4_k4_u22s2" returned: 1 in 0.313s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86947621-9c42-4716-8f36-2217367081e4_k4_u22s2' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d46528-2894-4f2a-b2de-87f0d4aa0b55]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:46 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD Nov 02 10:19:46 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:47 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD" returned: 0 in 0.306s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:47 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD Nov 02 10:19:47 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:47 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD" returned: 1 in 0.306s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:19:47 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] 86947621-9c42-4716-8f36-2217367081e4 was raw, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:19:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:47 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 Nov 02 10:19:47 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:47 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78" returned: 0 in 0.465s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:47 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86947621-9c42-4716-8f36-2217367081e4_ligna1nudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:19:47 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:19:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:47 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 1G Nov 02 10:19:47 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:48 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 1G" returned: 0 in 0.333s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Downloaded image 86947621-9c42-4716-8f36-2217367081e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/86947621-9c42-4716-8f36-2217367081e4', 'metadata': {}}])) to volume 326a7680-cbde-4d5b-823b-a3dfff91de78 successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Temporary image 86947621-9c42-4716-8f36-2217367081e4 for user 411eb2f9a9c74c0fb4b5e2c57d0abb09 is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Marking volume 326a7680-cbde-4d5b-823b-a3dfff91de78 as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Copying metadata from image 86947621-9c42-4716-8f36-2217367081e4 to 326a7680-cbde-4d5b-823b-a3dfff91de78. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Creating volume glance metadata for volume 326a7680-cbde-4d5b-823b-a3dfff91de78 backed by image 86947621-9c42-4716-8f36-2217367081e4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '86947621-9c42-4716-8f36-2217367081e4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '36c57a6435bbe5a9dc8acdc5490aec43', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026f0402-0122-44fc-9250-8b1034140587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326a7680-cbde-4d5b-823b-a3dfff91de78', 'volume_size': 1, 'image_id': '86947621-9c42-4716-8f36-2217367081e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86947621-9c42-4716-8f36-2217367081e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36c57a6435bbe5a9dc8acdc5490aec43', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cffc0a1aa6546c7968921b08cec383c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f310f3708970137c2156ac7dc24cf6b2b0b066d4c76f9f2b49c4ff1d2147fcf556636e06f7d029725fe601ad10a77781230c599067070fc4a1de88ef705d1d35', 'id': '86947621-9c42-4716-8f36-2217367081e4', 'created_at': datetime.datetime(2026, 11, 2, 9, 19, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 19, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86947621-9c42-4716-8f36-2217367081e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0733d31c-a435-4d5a-89ef-f40ae9ad08ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:48 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Volume volume-326a7680-cbde-4d5b-823b-a3dfff91de78 (326a7680-cbde-4d5b-823b-a3dfff91de78): created successfully Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0733d31c-a435-4d5a-89ef-f40ae9ad08ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Flow 'volume_create_manager' (dcfa6ce6-bc04-4dd9-8859-adc8996d5ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f68d4fee-3e15-4765-8160-1878ae21f983 tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Created volume successfully. Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Acquiring lock "cinder-326a7680-cbde-4d5b-823b-a3dfff91de78-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "cinder-326a7680-cbde-4d5b-823b-a3dfff91de78-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Acquiring lock "cinder-quobyte-326a7680-cbde-4d5b-823b-a3dfff91de78" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "cinder-quobyte-326a7680-cbde-4d5b-823b-a3dfff91de78" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[865df54a-7492-4b9c-9fa9-93a438563e2e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:49 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 Nov 02 10:19:49 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:49 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78" returned: 0 in 0.360s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:49 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78 Nov 02 10:19:49 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:49 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-326a7680-cbde-4d5b-823b-a3dfff91de78" returned: 0 in 0.288s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "cinder-quobyte-326a7680-cbde-4d5b-823b-a3dfff91de78" released by "delete_volume" :: held 0.692s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:49 devstack cinder-volume[86840]: WARNING cinder.quota [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:19:49 devstack cinder-volume[86840]: WARNING cinder.quota [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Created reservations ['632df239-0b14-41dc-906b-2efcb713a35e', '6d04b466-84ba-4448-9a40-aec90f558751', 'd5abf459-0509-46fd-871c-fcf3a4a690fd', '84fdbd0f-d1f3-4158-abb6-7e2080d93b0a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:49 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:19:49 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:50 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.262s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:50 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:19:50 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Deleted volume successfully. Nov 02 10:19:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-28cf617f-cc29-4993-8f78-c7d9fa11b9ef tempest-VolumeAndVolumeTypeFromImageTest-1456509983 None] Lock "cinder-326a7680-cbde-4d5b-823b-a3dfff91de78-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Flow 'volume_create_manager' (62c1f0c5-f6ed-479c-b28e-9aed4bec0293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d891fae-c97b-4db9-b3b8-1c51b1cd74b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d891fae-c97b-4db9-b3b8-1c51b1cd74b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1286332808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ede5dc-52cf-4a70-95c1-2e09632a7014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66606eb6f6c4b21a2fdc9d1b60c2cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:55Z,use_quota=True,user_id='2ca32f856aba4c64a0a9b502a6c93c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092287a2-7ec5-4015-8e5d-d973bfa2100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092287a2-7ec5-4015-8e5d-d973bfa2100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065b81d1-3ced-4db4-ae75-a5228086c8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065b81d1-3ced-4db4-ae75-a5228086c8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ede5dc-52cf-4a70-95c1-2e09632a7014', 'volume_name': 'volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311df88e-14d3-4780-b72a-94e7da06d013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311df88e-14d3-4780-b72a-94e7da06d013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73b0e86-dd9a-440c-820c-2ff1c60a8d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:54 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Volume e3ede5dc-52cf-4a70-95c1-2e09632a7014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014', 'volume_size': 1} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1286332808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ede5dc-52cf-4a70-95c1-2e09632a7014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66606eb6f6c4b21a2fdc9d1b60c2cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:55Z,use_quota=True,user_id='2ca32f856aba4c64a0a9b502a6c93c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Creating volume e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:54 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:19:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:54 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 1073741824 Nov 02 10:19:54 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:55 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 1073741824" returned: 0 in 0.451s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:55 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 Nov 02 10:19:55 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:55 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014" returned: 0 in 0.317s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:19:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73b0e86-dd9a-440c-820c-2ff1c60a8d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fab369-92be-4f7a-97cb-c03464b65067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:55 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Volume volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 (e3ede5dc-52cf-4a70-95c1-2e09632a7014): created successfully Nov 02 10:19:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fab369-92be-4f7a-97cb-c03464b65067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Flow 'volume_create_manager' (62c1f0c5-f6ed-479c-b28e-9aed4bec0293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ea866c2e-705d-42c7-b9f8-bbfeab28a18b tempest-VolumeDependencyTests-1362659282 None] Created volume successfully. Nov 02 10:19:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Creating offline snapshot 136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 of volume e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:19:56 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc3e47e-f06a-40f4-a2c1-2810311367e9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:19:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:57 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 Nov 02 10:19:57 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:57 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014" returned: 0 in 0.362s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:57 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 1G Nov 02 10:19:57 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:57 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 1G" returned: 0 in 0.444s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:57 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 Nov 02 10:19:57 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:58 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58" returned: 0 in 0.310s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:58 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 is being set with open permissions: ugo+rw Nov 02 10:19:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:58 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 Nov 02 10:19:58 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:58 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58" returned: 0 in 0.246s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:58 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.info Nov 02 10:19:58 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:58 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.info" returned: 0 in 0.247s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:58 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.info is being set with open permissions: ugo+rw Nov 02 10:19:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:19:58 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.info Nov 02 10:19:58 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:19:58 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Nov 02 10:19:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.info" returned: 0 in 0.238s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:19:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:58 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6c5b0096-8871-4ff4-8078-f3e2c8891d26 tempest-VolumeDependencyTests-1362659282 None] Create snapshot completed successfully Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Flow 'volume_create_manager' (eaab5377-269c-4155-9f30-6f06751bfb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc989ab-e685-4217-a3a4-ff0cb529a62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc989ab-e685-4217-a3a4-ff0cb529a62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-466823763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6a453b-e267-47e1-b715-9bb3ef8e2103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66606eb6f6c4b21a2fdc9d1b60c2cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=136b0a5c-1770-4f34-9c5d-feb7cb2d3c58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:00Z,use_quota=True,user_id='2ca32f856aba4c64a0a9b502a6c93c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dfa9aa-6340-44a5-abb5-efe0e77069ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42dfa9aa-6340-44a5-abb5-efe0e77069ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37be06cc-4728-4d70-9b78-a71bff527720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37be06cc-4728-4d70-9b78-a71bff527720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e6a453b-e267-47e1-b715-9bb3ef8e2103', 'volume_name': 'volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103', 'volume_size': 1, 'snapshot_id': '136b0a5c-1770-4f34-9c5d-feb7cb2d3c58'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aac694f-44f7-4b37-b575-a83e4aef9ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aac694f-44f7-4b37-b575-a83e4aef9ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f5c0ea-3846-48ec-bacc-2a437f1da433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:19:59 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Volume 8e6a453b-e267-47e1-b715-9bb3ef8e2103: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103', 'volume_size': 1, 'snapshot_id': '136b0a5c-1770-4f34-9c5d-feb7cb2d3c58'} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "cinder-quobyte-136b0a5c-1770-4f34-9c5d-feb7cb2d3c58-8e6a453b-e267-47e1-b715-9bb3ef8e2103" by "_create_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-136b0a5c-1770-4f34-9c5d-feb7cb2d3c58-8e6a453b-e267-47e1-b715-9bb3ef8e2103" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Creating volume 8e6a453b-e267-47e1-b715-9bb3ef8e2103 from snapshot 136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 {{(pid=86840) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "cinder-quobyte-8e6a453b-e267-47e1-b715-9bb3ef8e2103" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-8e6a453b-e267-47e1-b715-9bb3ef8e2103" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:19:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] snapshot: 136b0a5c-1770-4f34-9c5d-feb7cb2d3c58, volume: 8e6a453b-e267-47e1-b715-9bb3ef8e2103, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ecc143-efa0-4036-a001-1e91f23d1ca7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:00 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 Nov 02 10:20:00 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:00 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58" returned: 0 in 0.350s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3365f5-d253-41d6-9973-2331f55d666b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:00 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 Nov 02 10:20:00 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:00 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014" returned: 0 in 0.391s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:20:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:00 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 Nov 02 10:20:00 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:06 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103" returned: 0 in 6.085s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:06 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:20:06 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Converted 1024.00 MB image at 168.24 MB/s Nov 02 10:20:06 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 is being set with open permissions: ugo+rw Nov 02 10:20:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:06 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 Nov 02 10:20:06 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:07 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103" returned: 0 in 0.234s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-8e6a453b-e267-47e1-b715-9bb3ef8e2103" released by "_copy_volume_from_snapshot" :: held 7.137s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-136b0a5c-1770-4f34-9c5d-feb7cb2d3c58-8e6a453b-e267-47e1-b715-9bb3ef8e2103" released by "_create_volume_from_snapshot" :: held 7.197s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.213s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f5c0ea-3846-48ec-bacc-2a437f1da433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103', 'volume_size': 1, 'snapshot_id': '136b0a5c-1770-4f34-9c5d-feb7cb2d3c58'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0d33d6-cb97-4942-b308-f55cc296a12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Volume volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 (8e6a453b-e267-47e1-b715-9bb3ef8e2103): created successfully Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0d33d6-cb97-4942-b308-f55cc296a12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Flow 'volume_create_manager' (eaab5377-269c-4155-9f30-6f06751bfb5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-be3ff5ec-a8af-4402-aff7-501601a25e3f tempest-VolumeDependencyTests-1362659282 None] Created volume successfully. Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "cinder-136b0a5c-1770-4f34-9c5d-feb7cb2d3c58-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-136b0a5c-1770-4f34-9c5d-feb7cb2d3c58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "cinder-quobyte-e3ede5dc-52cf-4a70-95c1-2e09632a7014" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-e3ede5dc-52cf-4a70-95c1-2e09632a7014" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "cinder-quobyte-136b0a5c-1770-4f34-9c5d-feb7cb2d3c58" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-136b0a5c-1770-4f34-9c5d-feb7cb2d3c58" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Deleting offline snapshot 136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 of volume e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] snapshot_file for this snap is: volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8472db-e798-49fb-a556-3b7fcb8a1fc5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:07 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 Nov 02 10:20:07 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:07 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58" returned: 0 in 0.369s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7584aaea-7b63-499b-b96d-88b11580a3c3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:08 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 Nov 02 10:20:08 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:08 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014" returned: 0 in 0.535s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:08 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 Nov 02 10:20:08 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:08 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58" returned: 0 in 0.347s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:08 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58 Nov 02 10:20:08 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:09 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014.136b0a5c-1770-4f34-9c5d-feb7cb2d3c58" returned: 0 in 0.242s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-136b0a5c-1770-4f34-9c5d-feb7cb2d3c58" released by "_delete_snapshot" :: held 1.595s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-e3ede5dc-52cf-4a70-95c1-2e09632a7014" released by "delete_snapshot" :: held 1.622s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Created reservations ['f785d37b-7510-4a64-a73e-18f21ed062bb', '9ff626f5-5654-4ec2-b707-4557d540c49d', '5c9d9f44-fed2-4505-a0b2-590c681df8a8', 'f38b3024-7a09-4357-b743-7fdb795d5d25'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Delete snapshot completed successfully. Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d356ccd7-585c-4a49-aba9-aade589c4be3 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-136b0a5c-1770-4f34-9c5d-feb7cb2d3c58-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "cinder-e3ede5dc-52cf-4a70-95c1-2e09632a7014-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-e3ede5dc-52cf-4a70-95c1-2e09632a7014-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "cinder-quobyte-e3ede5dc-52cf-4a70-95c1-2e09632a7014" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-e3ede5dc-52cf-4a70-95c1-2e09632a7014" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54c85a2-3dad-4186-b1e5-895df32c5b4f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:09 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 Nov 02 10:20:09 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014" returned: 0 in 0.376s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:10 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014 Nov 02 10:20:10 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e3ede5dc-52cf-4a70-95c1-2e09632a7014" returned: 0 in 0.240s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-e3ede5dc-52cf-4a70-95c1-2e09632a7014" released by "delete_volume" :: held 0.680s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Created reservations ['1a6d1b15-5ab3-4254-8d0f-5c56b6fb0e95', '3cfdaf17-ff23-446f-aa50-37743aedb964', 'f90632f9-8e17-42ce-9d00-88f023d0d10e', 'dca0e633-41af-4103-91a5-7475203f99dc'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:10 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:10 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:10 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.242s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Deleted volume successfully. Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ba5a371b-7ebd-4117-8c8d-1b739d9706e1 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-e3ede5dc-52cf-4a70-95c1-2e09632a7014-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "cinder-8e6a453b-e267-47e1-b715-9bb3ef8e2103-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-8e6a453b-e267-47e1-b715-9bb3ef8e2103-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "cinder-quobyte-8e6a453b-e267-47e1-b715-9bb3ef8e2103" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-8e6a453b-e267-47e1-b715-9bb3ef8e2103" acquired by "delete_volume" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e324146a-545d-4e91-bb30-d0758ef08de7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:11 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 Nov 02 10:20:11 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:11 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103" returned: 0 in 0.359s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:11 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103 Nov 02 10:20:11 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:11 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-8e6a453b-e267-47e1-b715-9bb3ef8e2103" returned: 0 in 0.262s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-quobyte-8e6a453b-e267-47e1-b715-9bb3ef8e2103" released by "delete_volume" :: held 0.666s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Created reservations ['6782ef85-1aea-4f05-a28b-abe826a2d72c', 'bb4c88b5-5852-4ae8-8cf9-97073055688e', '476f93ba-baba-4d3b-8f54-ab7ccd8e7251', 'f813e031-d4c5-46bf-bcfc-c77e9329c173'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:11 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:11 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:11 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.250s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:11 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Deleted volume successfully. Nov 02 10:20:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7c21354-e5a7-40df-a64c-07119633c129 tempest-VolumeDependencyTests-1362659282 None] Lock "cinder-8e6a453b-e267-47e1-b715-9bb3ef8e2103-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:20:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:20 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:20 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:21 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.263s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:20:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:20:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:20:21 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=40,cinder:UPDATE=39,cinder:INSERT=16,cinder:DELETE=1 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:20:21 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=35,cinder:INSERT=14,cinder:UPDATE=44,cinder:DELETE=6 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (bc076751-6384-4af0-8268-d253a932d5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d746f9cf-e179-4b37-964c-3ed78e83d382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d746f9cf-e179-4b37-964c-3ed78e83d382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1804334970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd75d174-198f-479b-b4a0-5a7c32afa082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:29Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c624d8d6-92f4-412c-9164-98f34b93ab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c624d8d6-92f4-412c-9164-98f34b93ab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7c450b-2c12-4012-a90d-50db92e278fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7c450b-2c12-4012-a90d-50db92e278fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd75d174-198f-479b-b4a0-5a7c32afa082', 'volume_name': 'volume-cd75d174-198f-479b-b4a0-5a7c32afa082', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41233d01-52fc-4b59-ae3e-731d8a182418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41233d01-52fc-4b59-ae3e-731d8a182418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2574b14c-d0da-4a6e-8e9a-c2b1e7e0d426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume cd75d174-198f-479b-b4a0-5a7c32afa082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd75d174-198f-479b-b4a0-5a7c32afa082', 'volume_size': 1} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1804334970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd75d174-198f-479b-b4a0-5a7c32afa082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:29Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Creating volume cd75d174-198f-479b-b4a0-5a7c32afa082 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:29 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:29 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 1073741824 Nov 02 10:20:29 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (6229062b-4720-4d93-a886-517565556bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f774b8d-7bd3-4bc6-8478-55d11e64a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f774b8d-7bd3-4bc6-8478-55d11e64a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557760919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d6f29c-ba5b-4ad2-b308-2aa10ffc2808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:29Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98d9de5-72fe-416f-91e3-024baa6fd691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98d9de5-72fe-416f-91e3-024baa6fd691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515025bc-c6a5-4668-9a7a-7b33b2798182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515025bc-c6a5-4668-9a7a-7b33b2798182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d6f29c-ba5b-4ad2-b308-2aa10ffc2808', 'volume_name': 'volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d5ce9a-dbe9-4cef-9369-7ba635d96eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d5ce9a-dbe9-4cef-9369-7ba635d96eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0209dc4-83eb-413d-9188-a4015d05bca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume 22d6f29c-ba5b-4ad2-b308-2aa10ffc2808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808', 'volume_size': 1} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (290ee625-2d9e-4b56-aac7-0be462ec035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d3badb-9ea8-4c4a-9000-500ab43b4f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d3badb-9ea8-4c4a-9000-500ab43b4f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762669817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c77be7d-0ba1-453c-8534-1ddaeb6400f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:30Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab0c432-f5c3-4c15-bdf9-3be0b5f5cf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab0c432-f5c3-4c15-bdf9-3be0b5f5cf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583bf42e-4bd8-4c5f-8e2d-0e2ec0108838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583bf42e-4bd8-4c5f-8e2d-0e2ec0108838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c77be7d-0ba1-453c-8534-1ddaeb6400f2', 'volume_name': 'volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83a0b25-2d84-4209-96c6-e4af802de8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83a0b25-2d84-4209-96c6-e4af802de8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcab38a-8f97-469c-8468-17fc96d4c971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:29 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Volume 1c77be7d-0ba1-453c-8534-1ddaeb6400f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2', 'volume_size': 1} Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:29 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 1073741824" returned: 0 in 0.580s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:30 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 Nov 02 10:20:30 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:30 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (b460d476-f081-46fb-b520-e3280d6d1365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3afae01-ccdb-4e1f-9332-229fd3dccd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082" returned: 0 in 0.326s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-557760919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d6f29c-ba5b-4ad2-b308-2aa10ffc2808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:29Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Creating volume 22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:30 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3afae01-ccdb-4e1f-9332-229fd3dccd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-269753866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4576371d-1408-487d-b2f2-986e848b483b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:30Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de12b67-fc7c-441f-aa98-7da75d46a367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 1073741824 Nov 02 10:20:30 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de12b67-fc7c-441f-aa98-7da75d46a367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413f9d71-6450-45e5-a17d-a8b8cf6f0f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413f9d71-6450-45e5-a17d-a8b8cf6f0f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4576371d-1408-487d-b2f2-986e848b483b', 'volume_name': 'volume-4576371d-1408-487d-b2f2-986e848b483b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bbc349-342c-4a9b-9e6b-a2ef3b0a58fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bbc349-342c-4a9b-9e6b-a2ef3b0a58fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5ba7a1-6911-489b-a092-c59f0e68c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Volume 4576371d-1408-487d-b2f2-986e848b483b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4576371d-1408-487d-b2f2-986e848b483b', 'volume_size': 1} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2574b14c-d0da-4a6e-8e9a-c2b1e7e0d426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd75d174-198f-479b-b4a0-5a7c32afa082', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e903826-f244-41f8-9731-0df804162f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume volume-cd75d174-198f-479b-b4a0-5a7c32afa082 (cd75d174-198f-479b-b4a0-5a7c32afa082): created successfully Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e903826-f244-41f8-9731-0df804162f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (bc076751-6384-4af0-8268-d253a932d5dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:30 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-63eb8e5f-3264-4e18-ae82-af1a35d963e7 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created volume successfully. Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (f02189df-c26e-4ac5-9d9e-41ca4e4d8e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d723a7-c4a5-400e-abbd-dd977c603d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d723a7-c4a5-400e-abbd-dd977c603d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775804881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6627c354-9f7a-43e9-9da6-283377007a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:31Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d2aad6-d75b-4ca9-bcf1-a90fe423ad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d2aad6-d75b-4ca9-bcf1-a90fe423ad93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a58cf2c-a4b6-42b6-ab48-ea6d6b0964fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a58cf2c-a4b6-42b6-ab48-ea6d6b0964fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6627c354-9f7a-43e9-9da6-283377007a68', 'volume_name': 'volume-6627c354-9f7a-43e9-9da6-283377007a68', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23af88cf-2453-4b34-aaf5-906de5f4682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23af88cf-2453-4b34-aaf5-906de5f4682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6308053-4c84-457a-a9f6-4855c3f331cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:30 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Volume 6627c354-9f7a-43e9-9da6-283377007a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6627c354-9f7a-43e9-9da6-283377007a68', 'volume_size': 1} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:30 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 1073741824" returned: 0 in 0.559s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:31 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 Nov 02 10:20:31 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:31 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808" returned: 0 in 0.438s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.501s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762669817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c77be7d-0ba1-453c-8534-1ddaeb6400f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:30Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Creating volume 1c77be7d-0ba1-453c-8534-1ddaeb6400f2 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:31 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0209dc4-83eb-413d-9188-a4015d05bca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 1073741824 Nov 02 10:20:31 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546b4284-8ada-496c-a2fc-f852e41017bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (b28056bb-69d2-4c15-a8bd-187c75a8601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e326d3b5-16b4-4593-b86c-3642b234131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 (22d6f29c-ba5b-4ad2-b308-2aa10ffc2808): created successfully Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546b4284-8ada-496c-a2fc-f852e41017bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (6229062b-4720-4d93-a886-517565556bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e326d3b5-16b4-4593-b86c-3642b234131f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-102993337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794efefe-5bb4-4aa8-9b56-4b49a12fe60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:31Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7585f7-8efd-469c-9353-5fd107207e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7585f7-8efd-469c-9353-5fd107207e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771de354-cce8-4f24-8b55-cbe1d09a321b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771de354-cce8-4f24-8b55-cbe1d09a321b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794efefe-5bb4-4aa8-9b56-4b49a12fe60f', 'volume_name': 'volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e32b2c9-922f-4856-9792-d472ca0647d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e32b2c9-922f-4856-9792-d472ca0647d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa96ff7f-1356-4add-88b7-aa90b854b135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Volume 794efefe-5bb4-4aa8-9b56-4b49a12fe60f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f', 'volume_size': 1} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d2e9a36b-6e8c-4b93-8ed3-1fb355f36473 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created volume successfully. Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (4be40ce1-a19f-41e9-af82-a20971a0f2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d0184f-7dd7-414c-ab8d-5379921ad9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d0184f-7dd7-414c-ab8d-5379921ad9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-573363365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32437a1b-b403-4aab-b501-fc63228aa12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:32Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342f9d0c-4c40-4499-815f-8321ec723687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342f9d0c-4c40-4499-815f-8321ec723687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924edc15-7f28-4bfb-85d2-b48cb83685c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924edc15-7f28-4bfb-85d2-b48cb83685c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32437a1b-b403-4aab-b501-fc63228aa12b', 'volume_name': 'volume-32437a1b-b403-4aab-b501-fc63228aa12b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdec497-51bb-454f-9356-17e98df26b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdec497-51bb-454f-9356-17e98df26b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b121109b-ca33-4f45-92e0-f003ef49e84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:32 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Volume 32437a1b-b403-4aab-b501-fc63228aa12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32437a1b-b403-4aab-b501-fc63228aa12b', 'volume_size': 1} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:32 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 1073741824" returned: 0 in 0.587s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:32 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 Nov 02 10:20:32 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:32 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2" returned: 0 in 0.249s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.865s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-269753866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4576371d-1408-487d-b2f2-986e848b483b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:30Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Creating volume 4576371d-1408-487d-b2f2-986e848b483b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:32 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcab38a-8f97-469c-8468-17fc96d4c971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b9b722-dfe4-4a1c-b5a9-e9082e748898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:32 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b 1073741824 Nov 02 10:20:32 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:32 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Volume volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 (1c77be7d-0ba1-453c-8534-1ddaeb6400f2): created successfully Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b9b722-dfe4-4a1c-b5a9-e9082e748898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (290ee625-2d9e-4b56-aac7-0be462ec035e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:32 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-adf9bd2a-3da4-43f5-a36b-8de6f7e201a5 tempest-CreateVolumesFromImageTest-642970155 None] Created volume successfully. Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (62313bc0-000f-47c0-8186-34f28fd86be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:32 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f52b02-519c-485d-b4d2-4cb0dfbbc049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b 1073741824" returned: 0 in 0.639s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f52b02-519c-485d-b4d2-4cb0dfbbc049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344383976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b79c22-328e-41e5-a991-a5f519188ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:33Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e797f67-dff6-4bcb-96bd-738a844974b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e797f67-dff6-4bcb-96bd-738a844974b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e82915-6fef-4815-a375-6a1bc0d3acc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e82915-6fef-4815-a375-6a1bc0d3acc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b79c22-328e-41e5-a991-a5f519188ba7', 'volume_name': 'volume-f4b79c22-328e-41e5-a991-a5f519188ba7', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8608cc-2406-48e0-bfd1-7d56b9d044aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8608cc-2406-48e0-bfd1-7d56b9d044aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d75303e-4718-4ab2-9ec0-59d8dcb686e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume f4b79c22-328e-41e5-a991-a5f519188ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b79c22-328e-41e5-a991-a5f519188ba7', 'volume_size': 1} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:33 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b Nov 02 10:20:33 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:33 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b" returned: 0 in 0.309s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.563s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775804881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6627c354-9f7a-43e9-9da6-283377007a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:31Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Creating volume 6627c354-9f7a-43e9-9da6-283377007a68 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:33 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5ba7a1-6911-489b-a092-c59f0e68c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4576371d-1408-487d-b2f2-986e848b483b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68 1073741824 Nov 02 10:20:33 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3522350f-43b5-4356-abed-5e41ab31dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Volume volume-4576371d-1408-487d-b2f2-986e848b483b (4576371d-1408-487d-b2f2-986e848b483b): created successfully Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3522350f-43b5-4356-abed-5e41ab31dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (b460d476-f081-46fb-b520-e3280d6d1365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f9f8d898-73de-418a-8950-505826d09623 tempest-CreateVolumesFromImageTest-642970155 None] Created volume successfully. Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (09395dac-4732-44ce-a2e0-a0326bfe2902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caef2b9b-b50f-426e-bff4-26ce3774c02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caef2b9b-b50f-426e-bff4-26ce3774c02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-815389377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40941bb1-548a-4d97-8978-4df066013e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:33Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf1debc-388a-445a-a5e2-7f6213457cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf1debc-388a-445a-a5e2-7f6213457cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b125ea-9c2e-46f7-bf19-e1956da508e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b125ea-9c2e-46f7-bf19-e1956da508e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40941bb1-548a-4d97-8978-4df066013e6a', 'volume_name': 'volume-40941bb1-548a-4d97-8978-4df066013e6a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c4a5c5-818f-4a96-8e17-835abee2aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c4a5c5-818f-4a96-8e17-835abee2aa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24219b58-1e2d-4ce2-9bbe-0d6d9c1344f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume 40941bb1-548a-4d97-8978-4df066013e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40941bb1-548a-4d97-8978-4df066013e6a', 'volume_size': 1} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Flow 'volume_create_manager' (7269ba5d-43eb-4c43-a525-a26a58605b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de26f33e-c597-4716-bbde-5699255b9cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de26f33e-c597-4716-bbde-5699255b9cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bee361b-46c8-4c4c-a027-26db9f103ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53d89c1d6f94b25821edcee309ee344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:34Z,use_quota=True,user_id='5492340431474942994c436713784fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1109c62c-2bad-4d88-a394-08db5758b00f),volume_type_id=1109c62c-2bad-4d88-a394-08db5758b00f)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee702bd2-ecd0-4a91-b958-56535a92310f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee702bd2-ecd0-4a91-b958-56535a92310f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6cbfb0-9a62-450a-9a82-596ff05c1367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (76aca7be-dcb1-470f-a1df-5e421e7e103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c301a62e-af28-4bbb-9534-47c86f994bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c301a62e-af28-4bbb-9534-47c86f994bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348584792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cf78f5-23f3-4874-a9a4-536a46422afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:34Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88f9d18-16d7-4a45-83f4-f3e86fd53b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88f9d18-16d7-4a45-83f4-f3e86fd53b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db07431-f8b6-4078-8f31-1ae95e08b3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db07431-f8b6-4078-8f31-1ae95e08b3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cf78f5-23f3-4874-a9a4-536a46422afc', 'volume_name': 'volume-41cf78f5-23f3-4874-a9a4-536a46422afc', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822ff21d-e952-4768-aa71-3e40f08031f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822ff21d-e952-4768-aa71-3e40f08031f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a022a06d-cf93-4b96-970d-905eac349923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume 41cf78f5-23f3-4874-a9a4-536a46422afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cf78f5-23f3-4874-a9a4-536a46422afc', 'volume_size': 1} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68 1073741824" returned: 0 in 0.645s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:34 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68 Nov 02 10:20:34 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6cbfb0-9a62-450a-9a82-596ff05c1367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bee361b-46c8-4c4c-a027-26db9f103ad0', 'volume_name': 'volume-9bee361b-46c8-4c4c-a027-26db9f103ad0', 'volume_size': 1, 'image_id': '50cb2504-97ca-4686-a406-c6b71dbf20a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50cb2504-97ca-4686-a406-c6b71dbf20a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f4b81f2f7d4da84d8683a49840f8059', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c53d89c1d6f94b25821edcee309ee344', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f22f8c27725042794670abbb9d4dba0316100cc866081aac902715a3ced219e0eaa7fdda7677883b7e1ff91502081933b8a4ee9ee1a93735fff67141b3200614', 'id': '50cb2504-97ca-4686-a406-c6b71dbf20a2', 'created_at': datetime.datetime(2026, 11, 2, 9, 20, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 20, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50cb2504-97ca-4686-a406-c6b71dbf20a2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d5b99b-dd08-43be-a2b1-9444478ab82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d5b99b-dd08-43be-a2b1-9444478ab82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d51b21-fb7e-4ff9-a94f-0604341afcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Volume 9bee361b-46c8-4c4c-a027-26db9f103ad0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bee361b-46c8-4c4c-a027-26db9f103ad0', 'volume_size': 1, 'image_id': '50cb2504-97ca-4686-a406-c6b71dbf20a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50cb2504-97ca-4686-a406-c6b71dbf20a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f4b81f2f7d4da84d8683a49840f8059', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c53d89c1d6f94b25821edcee309ee344', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f22f8c27725042794670abbb9d4dba0316100cc866081aac902715a3ced219e0eaa7fdda7677883b7e1ff91502081933b8a4ee9ee1a93735fff67141b3200614', 'id': '50cb2504-97ca-4686-a406-c6b71dbf20a2', 'created_at': datetime.datetime(2026, 11, 2, 9, 20, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 20, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50cb2504-97ca-4686-a406-c6b71dbf20a2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Trying to clone 9bee361b-46c8-4c4c-a027-26db9f103ad0 from image 50cb2504-97ca-4686-a406-c6b71dbf20a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/50cb2504-97ca-4686-a406-c6b71dbf20a2', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:20:34 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (3a6eccf6-ebbd-4886-9abe-5abf32a644e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf84f49-9506-48ed-b081-e557f97a3ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf84f49-9506-48ed-b081-e557f97a3ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672569213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c6e1c3-1b1d-41f5-962f-432123bd81a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:34Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fedb01-cda0-47db-8590-35f049c99579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fedb01-cda0-47db-8590-35f049c99579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a727b004-89c0-4d77-b608-59b1659bc2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a727b004-89c0-4d77-b608-59b1659bc2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c6e1c3-1b1d-41f5-962f-432123bd81a6', 'volume_name': 'volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6381cd8b-2d0e-4d87-8a84-846b3126b9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6381cd8b-2d0e-4d87-8a84-846b3126b9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af6af92-aa66-4b15-8982-8051c197d1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume d7c6e1c3-1b1d-41f5-962f-432123bd81a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6', 'volume_size': 1} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68" returned: 0 in 0.363s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb70579-6c51-4196-8a6e-9b8798ed6735]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.775s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-102993337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794efefe-5bb4-4aa8-9b56-4b49a12fe60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:31Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Creating volume 794efefe-5bb4-4aa8-9b56-4b49a12fe60f {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:34 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:34 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f 1073741824 Nov 02 10:20:34 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6308053-4c84-457a-a9f6-4855c3f331cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6627c354-9f7a-43e9-9da6-283377007a68', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1c7337-fd6f-4f6d-96df-b845826fbdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Volume volume-6627c354-9f7a-43e9-9da6-283377007a68 (6627c354-9f7a-43e9-9da6-283377007a68): created successfully Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1c7337-fd6f-4f6d-96df-b845826fbdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (f02189df-c26e-4ac5-9d9e-41ca4e4d8e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-91a2fedb-afbb-4b10-95c7-17c7430a966a tempest-CreateVolumesFromImageTest-642970155 None] Created volume successfully. Nov 02 10:20:34 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD Nov 02 10:20:34 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (9517ed58-796e-4dda-8598-4b6be4c9bb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2965b47-7e6f-4b35-a505-98491dac4eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2965b47-7e6f-4b35-a505-98491dac4eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1632192190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c468a3a-737c-4bce-9553-9024df5afddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:35Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcfe256-562a-44cb-8544-396b5e3f1c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcfe256-562a-44cb-8544-396b5e3f1c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063720b7-a065-44a7-b5f0-3755eda434fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063720b7-a065-44a7-b5f0-3755eda434fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c468a3a-737c-4bce-9553-9024df5afddd', 'volume_name': 'volume-9c468a3a-737c-4bce-9553-9024df5afddd', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72631fa7-6fb0-4d05-ab70-50db94680d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72631fa7-6fb0-4d05-ab70-50db94680d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d4a35a-d9b1-491a-ae3d-08dafddc3d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:34 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume 9c468a3a-737c-4bce-9553-9024df5afddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c468a3a-737c-4bce-9553-9024df5afddd', 'volume_size': 1} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:34 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f 1073741824" returned: 0 in 0.490s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD Nov 02 10:20:35 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f Nov 02 10:20:35 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Temporary image 50cb2504-97ca-4686-a406-c6b71dbf20a2 is fetched for user 5492340431474942994c436713784fcc. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:20:35 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f" returned: 0 in 0.239s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.361s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa96ff7f-1356-4add-88b7-aa90b854b135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4661fded-2e17-4d56-8573-fe5bcb66b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Creating offline snapshot 07610b9d-65c9-4e4b-a5f8-0fe51350f983 of volume cd75d174-198f-479b-b4a0-5a7c32afa082 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:20:35 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Volume volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f (794efefe-5bb4-4aa8-9b56-4b49a12fe60f): created successfully Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4661fded-2e17-4d56-8573-fe5bcb66b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (b28056bb-69d2-4c15-a8bd-187c75a8601c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e35a4d8-cca8-4977-b053-c3c2dc057918]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-08ea9ee7-68d4-4aef-b200-9f349e32404e tempest-CreateVolumesFromImageTest-642970155 None] Created volume successfully. Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d034d33e-1ef9-4913-a836-9bbee7f565d8]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 Nov 02 10:20:35 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD Nov 02 10:20:35 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082" returned: 0 in 0.437s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:35 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 1G Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:35 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:35 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD Nov 02 10:20:35 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:36 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:36 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 1G" returned: 0 in 0.418s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd75d174-198f-479b-b4a0-5a7c32afa082 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:36 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd75d174-198f-479b-b4a0-5a7c32afa082 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 Nov 02 10:20:36 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:36 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd75d174-198f-479b-b4a0-5a7c32afa082 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983" returned: 0 in 0.313s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:36 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 is being set with open permissions: ugo+rw Nov 02 10:20:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:36 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 Nov 02 10:20:36 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:36 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983" returned: 0 in 0.231s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:36 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.info Nov 02 10:20:36 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:37 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.info" returned: 0 in 0.258s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:37 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.info is being set with open permissions: ugo+rw Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:37 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.info Nov 02 10:20:37 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:37 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.info" returned: 0 in 0.232s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.257s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-573363365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32437a1b-b403-4aab-b501-fc63228aa12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304468eefdb94205aa9efc330a0552ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:32Z,use_quota=True,user_id='51e22e699b6f4a58bc5cd7f6b49e2bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Creating volume 32437a1b-b403-4aab-b501-fc63228aa12b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:37 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:37 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b 1073741824 Nov 02 10:20:37 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:37 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-179a6f45-377f-4d4a-b8c1-01fbadd95324 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Create snapshot completed successfully Nov 02 10:20:37 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b 1073741824" returned: 0 in 0.422s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:37 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b Nov 02 10:20:37 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:37 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b" returned: 0 in 0.256s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.940s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344383976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b79c22-328e-41e5-a991-a5f519188ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:33Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Creating volume f4b79c22-328e-41e5-a991-a5f519188ba7 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:37 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b121109b-ca33-4f45-92e0-f003ef49e84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32437a1b-b403-4aab-b501-fc63228aa12b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2493053-4d6d-4404-8b18-d819ce801bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7 1073741824 Nov 02 10:20:38 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:38 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Volume volume-32437a1b-b403-4aab-b501-fc63228aa12b (32437a1b-b403-4aab-b501-fc63228aa12b): created successfully Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2493053-4d6d-4404-8b18-d819ce801bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Flow 'volume_create_manager' (4be40ce1-a19f-41e9-af82-a20971a0f2cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ee841bba-b4c1-44c1-9b88-e04bd96e1b56 tempest-CreateVolumesFromImageTest-642970155 None] Created volume successfully. Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (059f8eb4-16ad-43a8-94d2-9e3d49074efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f369f3-f568-4b23-9dea-b6fdcfa05db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f369f3-f568-4b23-9dea-b6fdcfa05db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1890024977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69182acc-9d9a-413a-abf9-d7fbcc4accfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:38Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb35d875-768e-407f-8cc9-142c0648b162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb35d875-768e-407f-8cc9-142c0648b162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12626cde-5114-48de-a2bd-0029bf3a3402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12626cde-5114-48de-a2bd-0029bf3a3402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69182acc-9d9a-413a-abf9-d7fbcc4accfd', 'volume_name': 'volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcb2422-cb30-40f6-bb86-1c7fa2a1a505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcb2422-cb30-40f6-bb86-1c7fa2a1a505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add9a3d2-0769-4976-8961-3ba3d29b3753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume 69182acc-9d9a-413a-abf9-d7fbcc4accfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd', 'volume_size': 1} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:38 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7 1073741824" returned: 0 in 0.577s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:38 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7 Nov 02 10:20:38 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (66249518-1455-4c41-95cb-54af411b5ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e3f0e1-98cb-480c-8df6-7e612334797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7" returned: 0 in 0.286s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.196s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-815389377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40941bb1-548a-4d97-8978-4df066013e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:33Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Creating volume 40941bb1-548a-4d97-8978-4df066013e6a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:38 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e3f0e1-98cb-480c-8df6-7e612334797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-868231526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa67c3cd-48e6-4f61-b106-992d7145d1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:39Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d11c5-fd90-4a6b-99c6-0fd6e5e7aabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d11c5-fd90-4a6b-99c6-0fd6e5e7aabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a 1073741824 Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fd8c63-1bb2-4a2c-84a3-2b8060ba611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:38 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fd8c63-1bb2-4a2c-84a3-2b8060ba611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa67c3cd-48e6-4f61-b106-992d7145d1be', 'volume_name': 'volume-fa67c3cd-48e6-4f61-b106-992d7145d1be', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ee7749-b38a-45df-a9cc-0146affb6a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ee7749-b38a-45df-a9cc-0146affb6a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdf16a6-9115-4f77-8ce6-947a756900da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:39 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume fa67c3cd-48e6-4f61-b106-992d7145d1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa67c3cd-48e6-4f61-b106-992d7145d1be', 'volume_size': 1} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-32437a1b-b403-4aab-b501-fc63228aa12b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d75303e-4718-4ab2-9ec0-59d8dcb686e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b79c22-328e-41e5-a991-a5f519188ba7', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d0b45f-0728-45ef-8e5e-9cc86ced9fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-32437a1b-b403-4aab-b501-fc63228aa12b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:39 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume volume-f4b79c22-328e-41e5-a991-a5f519188ba7 (f4b79c22-328e-41e5-a991-a5f519188ba7): created successfully Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d0b45f-0728-45ef-8e5e-9cc86ced9fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (62313bc0-000f-47c0-8186-34f28fd86be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0b95995d-90ce-46e8-b19e-f6a9d070bd8f tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created volume successfully. Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-quobyte-32437a1b-b403-4aab-b501-fc63228aa12b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-32437a1b-b403-4aab-b501-fc63228aa12b" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[220a18b4-a0ee-4799-90b5-48f8d4f1406d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:39 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b Nov 02 10:20:39 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:39 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a 1073741824" returned: 0 in 0.687s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:39 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b" returned: 0 in 0.528s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:39 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b Nov 02 10:20:39 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (76702bb2-96cb-48f5-af15-9c5bfedfbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80568a3b-3252-4d4a-9c7e-8940a0d0b8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80568a3b-3252-4d4a-9c7e-8940a0d0b8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905640997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0c124f-5400-4d2b-b582-631fec998b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:40Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5da9c86-4cd7-42e8-8639-5bc300b2337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5da9c86-4cd7-42e8-8639-5bc300b2337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8a6880-0ba3-47b7-b7d7-1951ad63a191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8a6880-0ba3-47b7-b7d7-1951ad63a191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d0c124f-5400-4d2b-b582-631fec998b2b', 'volume_name': 'volume-2d0c124f-5400-4d2b-b582-631fec998b2b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395894ad-925a-46b1-9a56-34032099849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395894ad-925a-46b1-9a56-34032099849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:39 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a Nov 02 10:20:39 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2dc54e-5430-4f3c-9f75-00744f526d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:39 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume 2d0c124f-5400-4d2b-b582-631fec998b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d0c124f-5400-4d2b-b582-631fec998b2b', 'volume_size': 1} Nov 02 10:20:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:40 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-32437a1b-b403-4aab-b501-fc63228aa12b" returned: 0 in 0.334s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-32437a1b-b403-4aab-b501-fc63228aa12b" released by "delete_volume" :: held 0.929s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:40 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a" returned: 0 in 0.395s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.104s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348584792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cf78f5-23f3-4874-a9a4-536a46422afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:34Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Creating volume 41cf78f5-23f3-4874-a9a4-536a46422afc {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:40 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:40 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc 1073741824 Nov 02 10:20:40 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Created reservations ['033a4838-c080-45a3-940f-e539fdf84c43', 'b851289c-86cf-4227-8437-9a9c57e6e441', 'a1e208a7-9ffd-46a4-8c66-2af46fe28c0d', 'a1833ff4-20a1-4ea7-a8c3-484416f91d20'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24219b58-1e2d-4ce2-9bbe-0d6d9c1344f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40941bb1-548a-4d97-8978-4df066013e6a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999cb9f7-f806-4890-ab12-fbe27583eb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume volume-40941bb1-548a-4d97-8978-4df066013e6a (40941bb1-548a-4d97-8978-4df066013e6a): created successfully Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999cb9f7-f806-4890-ab12-fbe27583eb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (09395dac-4732-44ce-a2e0-a0326bfe2902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (2e7adfa2-d5b4-49e2-b09c-63e9ee6e5528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4279c562-17d1-4ae7-af02-e752b1509a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-bd37ea44-f505-4e7c-bc2f-144eac03e85b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created volume successfully. Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4279c562-17d1-4ae7-af02-e752b1509a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1895846813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d298e7e-da4b-4f2a-aad5-29e928caa1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:40Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2b076f-d348-45f9-b63f-af2daab71c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2b076f-d348-45f9-b63f-af2daab71c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a38d8c8-8eb4-402c-b846-4171cf5b1987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a38d8c8-8eb4-402c-b846-4171cf5b1987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d298e7e-da4b-4f2a-aad5-29e928caa1e7', 'volume_name': 'volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37053a0-15bc-4df3-85e7-76065ec65f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37053a0-15bc-4df3-85e7-76065ec65f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b659d7a-8ad5-4f4d-8a6e-1b1088a2fd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume 5d298e7e-da4b-4f2a-aad5-29e928caa1e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7', 'volume_size': 1} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:40 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:40 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (c861d547-6011-40c2-b275-e29daf55f462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:40 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be1bfa5-1afd-4561-847f-f3ff2ac668f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc 1073741824" returned: 0 in 0.506s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be1bfa5-1afd-4561-847f-f3ff2ac668f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834042399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71961e91-6889-4870-ba10-092a3141e57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:41Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d15220-5daf-4bf8-ae8c-e691c4d9f0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d15220-5daf-4bf8-ae8c-e691c4d9f0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0ed8f3-7c33-43d8-bbb2-698a90f8944a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0ed8f3-7c33-43d8-bbb2-698a90f8944a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71961e91-6889-4870-ba10-092a3141e57b', 'volume_name': 'volume-71961e91-6889-4870-ba10-092a3141e57b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5308fa-67ce-41b8-b259-f4fd90a8548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5308fa-67ce-41b8-b259-f4fd90a8548d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:40 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6dbac8-50c1-4d84-9948-f7dd96f12455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:40 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume 71961e91-6889-4870-ba10-092a3141e57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71961e91-6889-4870-ba10-092a3141e57b', 'volume_size': 1} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.290s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:40 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Deleted volume successfully. Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4f440dfb-ee2f-4ad7-983c-8c2667478090 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-32437a1b-b403-4aab-b501-fc63228aa12b-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:40 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc Nov 02 10:20:40 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:41 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc" returned: 0 in 0.244s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.562s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672569213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c6e1c3-1b1d-41f5-962f-432123bd81a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:34Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Creating volume d7c6e1c3-1b1d-41f5-962f-432123bd81a6 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:41 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a022a06d-cf93-4b96-970d-905eac349923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cf78f5-23f3-4874-a9a4-536a46422afc', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:41 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 1073741824 Nov 02 10:20:41 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8189692a-46b8-4088-97e8-89e20d129064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:41 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume volume-41cf78f5-23f3-4874-a9a4-536a46422afc (41cf78f5-23f3-4874-a9a4-536a46422afc): created successfully Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8189692a-46b8-4088-97e8-89e20d129064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (76aca7be-dcb1-470f-a1df-5e421e7e103b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:41 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f76dbd7b-5123-42c0-bc04-b47fa70d6ccd tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created volume successfully. Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-794efefe-5bb4-4aa8-9b56-4b49a12fe60f-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-794efefe-5bb4-4aa8-9b56-4b49a12fe60f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-quobyte-794efefe-5bb4-4aa8-9b56-4b49a12fe60f" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-794efefe-5bb4-4aa8-9b56-4b49a12fe60f" acquired by "delete_volume" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ae27b6-fe94-4cda-b9f0-1ceb36c1d1d0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:41 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 1073741824" returned: 0 in 0.478s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:41 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f Nov 02 10:20:41 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:41 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 Nov 02 10:20:41 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:41 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f" returned: 0 in 0.367s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:41 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f Nov 02 10:20:41 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:41 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6" returned: 0 in 0.258s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.895s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1632192190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c468a3a-737c-4bce-9553-9024df5afddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1201d1aab8604c50b9fd27e2449cd9f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:35Z,use_quota=True,user_id='a00d698c94934c049f0a0230457e37ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Creating volume 9c468a3a-737c-4bce-9553-9024df5afddd {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:41 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af6af92-aa66-4b15-8982-8051c197d1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:41 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd 1073741824 Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f3bc82-cf1d-44b4-a38d-6409be1b753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:41 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:41 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 (d7c6e1c3-1b1d-41f5-962f-432123bd81a6): created successfully Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f3bc82-cf1d-44b4-a38d-6409be1b753a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:41 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (3a6eccf6-ebbd-4886-9abe-5abf32a644e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:41 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-19deb0c7-7637-48de-9d7e-2906e7d019b5 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created volume successfully. Nov 02 10:20:42 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-794efefe-5bb4-4aa8-9b56-4b49a12fe60f" returned: 0 in 0.266s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-794efefe-5bb4-4aa8-9b56-4b49a12fe60f" released by "delete_volume" :: held 0.676s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Created reservations ['12c7511a-7258-4783-b7ec-c6729f104633', 'c228aad8-88fd-43da-a200-0c5987442fbf', '414b9483-9062-4cac-9453-47c9d788563c', 'f9d2e129-35d6-412a-84e1-e78c1d194425'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:42 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:42 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:42 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd 1073741824" returned: 0 in 0.433s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:42 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd Nov 02 10:20:42 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:42 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.298s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:42 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Deleted volume successfully. Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-6627c354-9f7a-43e9-9da6-283377007a68-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-6627c354-9f7a-43e9-9da6-283377007a68-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c512a773-f6a4-4467-9be1-67d1c1e4ae25 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-794efefe-5bb4-4aa8-9b56-4b49a12fe60f-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-quobyte-6627c354-9f7a-43e9-9da6-283377007a68" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:42 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd" returned: 0 in 0.297s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-6627c354-9f7a-43e9-9da6-283377007a68" acquired by "delete_volume" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.441s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bee361b-46c8-4c4c-a027-26db9f103ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53d89c1d6f94b25821edcee309ee344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:34Z,use_quota=True,user_id='5492340431474942994c436713784fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1109c62c-2bad-4d88-a394-08db5758b00f),volume_type_id=1109c62c-2bad-4d88-a394-08db5758b00f)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Creating volume 9bee361b-46c8-4c4c-a027-26db9f103ad0 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:42 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e95187-7dc8-4e47-a295-fa09598fb1ca]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:42 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 1073741824 Nov 02 10:20:42 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d4a35a-d9b1-491a-ae3d-08dafddc3d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c468a3a-737c-4bce-9553-9024df5afddd', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c61e50-4a53-44d2-8eea-4fb9fc52dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:42 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Volume volume-9c468a3a-737c-4bce-9553-9024df5afddd (9c468a3a-737c-4bce-9553-9024df5afddd): created successfully Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c61e50-4a53-44d2-8eea-4fb9fc52dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Flow 'volume_create_manager' (9517ed58-796e-4dda-8598-4b6be4c9bb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:42 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0dddcd1c-4bd1-40ea-a1b0-470d4d7ff20c tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created volume successfully. Nov 02 10:20:42 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68 Nov 02 10:20:42 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:43 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68" returned: 0 in 0.428s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:43 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 1073741824" returned: 0 in 0.460s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:43 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68 Nov 02 10:20:43 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:43 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 Nov 02 10:20:43 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:43 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-6627c354-9f7a-43e9-9da6-283377007a68" returned: 0 in 0.254s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-6627c354-9f7a-43e9-9da6-283377007a68" released by "delete_volume" :: held 0.740s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:43 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0" returned: 0 in 0.248s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.806s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1890024977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69182acc-9d9a-413a-abf9-d7fbcc4accfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:38Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Creating volume 69182acc-9d9a-413a-abf9-d7fbcc4accfd {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:43 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:43 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd 1073741824 Nov 02 10:20:43 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Created reservations ['3c37bd6e-e59b-4764-8828-05c59db99a2c', '9c7af32d-a658-4992-a6e5-48f8b83e34f4', '80a0f85e-94cb-413a-94b7-f680b7a6a9a7', '9b112fd2-b7e6-4dbd-a172-8955a76a0fb8'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Attempting download of 50cb2504-97ca-4686-a406-c6b71dbf20a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/50cb2504-97ca-4686-a406-c6b71dbf20a2', 'metadata': {}}])) to volume 9bee361b-46c8-4c4c-a027-26db9f103ad0. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e84fff-0a60-48e2-a20a-90d65bb08d8b]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50cb2504-97ca-4686-a406-c6b71dbf20a2_09i9t02z {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:43 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:43 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:43 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50cb2504-97ca-4686-a406-c6b71dbf20a2_09i9t02z Nov 02 10:20:43 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-9c468a3a-737c-4bce-9553-9024df5afddd-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-9c468a3a-737c-4bce-9553-9024df5afddd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-4576371d-1408-487d-b2f2-986e848b483b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-4576371d-1408-487d-b2f2-986e848b483b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-quobyte-9c468a3a-737c-4bce-9553-9024df5afddd" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-quobyte-4576371d-1408-487d-b2f2-986e848b483b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:43 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50cb2504-97ca-4686-a406-c6b71dbf20a2_09i9t02z" returned: 0 in 0.428s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50cb2504-97ca-4686-a406-c6b71dbf20a2_09i9t02z {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-9c468a3a-737c-4bce-9553-9024df5afddd" acquired by "delete_volume" :: waited 0.079s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:43 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.452s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b7c161-eec8-42f4-9e38-5b4f00987d99]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-4576371d-1408-487d-b2f2-986e848b483b" acquired by "delete_volume" :: waited 0.092s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Deleted volume successfully. Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf42045-9cc4-4468-8804-a1829786da6c]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fd6e32d0-ec58-41c3-9469-b15982c058d0 tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-6627c354-9f7a-43e9-9da6-283377007a68-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:44 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50cb2504-97ca-4686-a406-c6b71dbf20a2_09i9t02z Nov 02 10:20:44 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd 1073741824" returned: 0 in 0.730s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:44 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:44 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd Nov 02 10:20:44 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:44 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b Nov 02 10:20:44 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd Nov 02 10:20:44 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:44 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:44 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50cb2504-97ca-4686-a406-c6b71dbf20a2_09i9t02z" returned: 1 in 0.441s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50cb2504-97ca-4686-a406-c6b71dbf20a2_09i9t02z' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f52210-829c-400b-9979-1d19a24d1e27]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:44 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd" returned: 0 in 0.260s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.420s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-868231526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa67c3cd-48e6-4f61-b106-992d7145d1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:39Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Creating volume fa67c3cd-48e6-4f61-b106-992d7145d1be {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:44 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add9a3d2-0769-4976-8961-3ba3d29b3753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8eb1ca-e9e4-486e-94d4-58fabcea28e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:44 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be 1073741824 Nov 02 10:20:44 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:44 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b" returned: 0 in 0.445s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:44 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd (69182acc-9d9a-413a-abf9-d7fbcc4accfd): created successfully Nov 02 10:20:44 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD Nov 02 10:20:44 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:44 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:44 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8eb1ca-e9e4-486e-94d4-58fabcea28e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:44 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (059f8eb4-16ad-43a8-94d2-9e3d49074efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd" returned: 0 in 0.560s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:44 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0a824fec-10e3-4cb3-94c3-e1e2c37f3c8b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created volume successfully. Nov 02 10:20:44 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd Nov 02 10:20:44 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:44 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-4576371d-1408-487d-b2f2-986e848b483b" returned: 0 in 0.342s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-4576371d-1408-487d-b2f2-986e848b483b" released by "delete_volume" :: held 0.845s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:44 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:44 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9c468a3a-737c-4bce-9553-9024df5afddd" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-9c468a3a-737c-4bce-9553-9024df5afddd" released by "delete_volume" :: held 0.989s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:44 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Created reservations ['ef928a3b-9f7b-48ba-b031-50ceb67478d1', '1ee3b366-e3c8-454d-8663-4220a298d9e9', 'fdcc9928-27c2-40f6-ba69-6183845cb0a4', '72697994-ff06-46de-a167-e75bbd2adf73'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created reservations ['bf0f28d2-166c-49e7-b839-0b5c4151895c', '2073de6f-d964-44e4-899d-e46554f723b7', '6935a104-8aba-40d9-b230-d1c6ed95ed40', 'bb049edf-c5c7-4418-b748-491dce68e503'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:45 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD Nov 02 10:20:45 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:45 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be 1073741824" returned: 0 in 0.629s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:45 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:45 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:45 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be Nov 02 10:20:45 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:45 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:45 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:45 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD" returned: 1 in 0.440s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] 50cb2504-97ca-4686-a406-c6b71dbf20a2 was raw, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:45 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 Nov 02 10:20:45 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:45 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.332s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Deleted volume successfully. Nov 02 10:20:45 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be" returned: 0 in 0.344s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.663s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905640997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0c124f-5400-4d2b-b582-631fec998b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:40Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Creating volume 2d0c124f-5400-4d2b-b582-631fec998b2b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:45 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:45 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2fb572e8-7f67-4b4c-833c-d7fa9abfa2dc tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-4576371d-1408-487d-b2f2-986e848b483b-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.358s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:45 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b 1073741824 Nov 02 10:20:45 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdf16a6-9115-4f77-8ce6-947a756900da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa67c3cd-48e6-4f61-b106-992d7145d1be', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c6888b-7d49-4f71-bd7c-12b75d9a6763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Deleted volume successfully. Nov 02 10:20:45 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume volume-fa67c3cd-48e6-4f61-b106-992d7145d1be (fa67c3cd-48e6-4f61-b106-992d7145d1be): created successfully Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c6888b-7d49-4f71-bd7c-12b75d9a6763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (66249518-1455-4c41-95cb-54af411b5ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-77d0dcd0-af1e-463d-95bd-fbd39e5e01d9 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-9c468a3a-737c-4bce-9553-9024df5afddd-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-026c1124-de6a-4b04-935b-7d739ffeb4aa tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created volume successfully. Nov 02 10:20:45 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0" returned: 0 in 0.536s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_50cb2504-97ca-4686-a406-c6b71dbf20a2_ekgmh06hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:20:45 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:20:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:45 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 1G Nov 02 10:20:45 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:46 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b 1073741824" returned: 0 in 0.500s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b Nov 02 10:20:46 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-1c77be7d-0ba1-453c-8534-1ddaeb6400f2-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-1c77be7d-0ba1-453c-8534-1ddaeb6400f2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "cinder-quobyte-1c77be7d-0ba1-453c-8534-1ddaeb6400f2" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:46 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-1c77be7d-0ba1-453c-8534-1ddaeb6400f2" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 1G" returned: 0 in 0.403s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Downloaded image 50cb2504-97ca-4686-a406-c6b71dbf20a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/50cb2504-97ca-4686-a406-c6b71dbf20a2', 'metadata': {}}])) to volume 9bee361b-46c8-4c4c-a027-26db9f103ad0 successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Temporary image 50cb2504-97ca-4686-a406-c6b71dbf20a2 for user 5492340431474942994c436713784fcc is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Marking volume 9bee361b-46c8-4c4c-a027-26db9f103ad0 as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Copying metadata from image 50cb2504-97ca-4686-a406-c6b71dbf20a2 to 9bee361b-46c8-4c4c-a027-26db9f103ad0. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Creating volume glance metadata for volume 9bee361b-46c8-4c4c-a027-26db9f103ad0 backed by image 50cb2504-97ca-4686-a406-c6b71dbf20a2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '50cb2504-97ca-4686-a406-c6b71dbf20a2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9f4b81f2f7d4da84d8683a49840f8059', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a96d3f-6bbd-4b13-ba3d-1ca5edbc0a11]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-d7c6e1c3-1b1d-41f5-962f-432123bd81a6-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-d7c6e1c3-1b1d-41f5-962f-432123bd81a6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:46 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b" returned: 0 in 0.345s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.021s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1895846813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d298e7e-da4b-4f2a-aad5-29e928caa1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:40Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Creating volume 5d298e7e-da4b-4f2a-aad5-29e928caa1e7 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:46 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 1073741824 Nov 02 10:20:46 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2dc54e-5430-4f3c-9f75-00744f526d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0c124f-5400-4d2b-b582-631fec998b2b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:46 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 Nov 02 10:20:46 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7849ef33-362f-45a2-ae22-218390b98c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-quobyte-d7c6e1c3-1b1d-41f5-962f-432123bd81a6" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume volume-2d0c124f-5400-4d2b-b582-631fec998b2b (2d0c124f-5400-4d2b-b582-631fec998b2b): created successfully Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7849ef33-362f-45a2-ae22-218390b98c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (76702bb2-96cb-48f5-af15-9c5bfedfbe64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-d7c6e1c3-1b1d-41f5-962f-432123bd81a6" acquired by "delete_volume" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d51b21-fb7e-4ff9-a94f-0604341afcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bee361b-46c8-4c4c-a027-26db9f103ad0', 'volume_size': 1, 'image_id': '50cb2504-97ca-4686-a406-c6b71dbf20a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50cb2504-97ca-4686-a406-c6b71dbf20a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9f4b81f2f7d4da84d8683a49840f8059', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c53d89c1d6f94b25821edcee309ee344', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f22f8c27725042794670abbb9d4dba0316100cc866081aac902715a3ced219e0eaa7fdda7677883b7e1ff91502081933b8a4ee9ee1a93735fff67141b3200614', 'id': '50cb2504-97ca-4686-a406-c6b71dbf20a2', 'created_at': datetime.datetime(2026, 11, 2, 9, 20, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 20, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50cb2504-97ca-4686-a406-c6b71dbf20a2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe29cdd-6470-41dd-ab26-6213ac08cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ae07ef-578f-4077-8e91-75403a451d80]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:46 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a2768665-ee1f-475c-b20c-5d56a4f83797 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created volume successfully. Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Volume volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 (9bee361b-46c8-4c4c-a027-26db9f103ad0): created successfully Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe29cdd-6470-41dd-ab26-6213ac08cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Flow 'volume_create_manager' (7269ba5d-43eb-4c43-a525-a26a58605b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:46 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-472911d9-c85c-4a4f-9e12-74055e8c6dd0 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Created volume successfully. Nov 02 10:20:46 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 Nov 02 10:20:46 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:46 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2" returned: 0 in 0.454s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2 Nov 02 10:20:46 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:46 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 1073741824" returned: 0 in 0.528s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:46 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6" returned: 0 in 0.436s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 Nov 02 10:20:47 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6 Nov 02 10:20:47 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1c77be7d-0ba1-453c-8534-1ddaeb6400f2" returned: 0 in 0.312s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-quobyte-1c77be7d-0ba1-453c-8534-1ddaeb6400f2" released by "delete_volume" :: held 0.834s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Created reservations ['429f916c-15dc-4062-b957-3eed31646595', '44c94202-72c6-4d45-9928-6be30c2203e1', 'cd6c01ff-80b3-4218-bbf0-1c532119ec74', 'cd62283f-32bd-4761-bdea-4b0638e00018'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:47 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7" returned: 0 in 0.330s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:47 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.580s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-834042399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71961e91-6889-4870-ba10-092a3141e57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b11966c2395745ee905fd1e91653322f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:41Z,use_quota=True,user_id='e4309165fc454cb9963f16a38435807d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Creating volume 71961e91-6889-4870-ba10-092a3141e57b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:47 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d7c6e1c3-1b1d-41f5-962f-432123bd81a6" returned: 0 in 0.354s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b 1073741824 Nov 02 10:20:47 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b659d7a-8ad5-4f4d-8a6e-1b1088a2fd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131eb9ae-887d-483d-b29d-cf4330957fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-d7c6e1c3-1b1d-41f5-962f-432123bd81a6" released by "delete_volume" :: held 0.900s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 (5d298e7e-da4b-4f2a-aad5-29e928caa1e7): created successfully Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131eb9ae-887d-483d-b29d-cf4330957fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (2e7adfa2-d5b4-49e2-b09c-63e9ee6e5528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:47 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.367s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Deleted volume successfully. Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created reservations ['19e7082c-3762-48f6-a885-b618afc26fc2', '140ac755-f770-4c75-8c5d-1c29e085cbaa', '28186719-aba3-4b17-9741-56a643a609e8', 'c96ad333-415b-4768-a323-c75d07bff57b'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:47 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8e9265e0-96e8-4d3b-8882-13f3a9e88779 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created volume successfully. Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4832fc4d-f68e-4fe8-9980-a55e803a8b9b tempest-CreateVolumesFromImageTest-642970155 None] Lock "cinder-1c77be7d-0ba1-453c-8534-1ddaeb6400f2-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Acquiring lock "cinder-9bee361b-46c8-4c4c-a027-26db9f103ad0-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "cinder-9bee361b-46c8-4c4c-a027-26db9f103ad0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:47 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Acquiring lock "cinder-quobyte-9bee361b-46c8-4c4c-a027-26db9f103ad0" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "cinder-quobyte-9bee361b-46c8-4c4c-a027-26db9f103ad0" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6145ed4-6457-436c-8fe5-e0a261bd3fc1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:47 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b 1073741824" returned: 0 in 0.649s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 Nov 02 10:20:48 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b Nov 02 10:20:48 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.323s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Deleted volume successfully. Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-93235c43-1832-498b-83f0-fcd1ae22c09b tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-d7c6e1c3-1b1d-41f5-962f-432123bd81a6-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:48 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0" returned: 0 in 0.429s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:48 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0 Nov 02 10:20:48 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b" returned: 0 in 0.337s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6dbac8-50c1-4d84-9948-f7dd96f12455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71961e91-6889-4870-ba10-092a3141e57b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c404bfd4-1197-480d-abe3-0e419b69e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:48 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Volume volume-71961e91-6889-4870-ba10-092a3141e57b (71961e91-6889-4870-ba10-092a3141e57b): created successfully Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c404bfd4-1197-480d-abe3-0e419b69e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Flow 'volume_create_manager' (c861d547-6011-40c2-b275-e29daf55f462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-78fc2abf-ffaf-46eb-b8fe-80896078f4c9 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created volume successfully. Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-41cf78f5-23f3-4874-a9a4-536a46422afc-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-41cf78f5-23f3-4874-a9a4-536a46422afc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-quobyte-41cf78f5-23f3-4874-a9a4-536a46422afc" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:48 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9bee361b-46c8-4c4c-a027-26db9f103ad0" returned: 0 in 0.406s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-41cf78f5-23f3-4874-a9a4-536a46422afc" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "cinder-quobyte-9bee361b-46c8-4c4c-a027-26db9f103ad0" released by "delete_volume" :: held 0.907s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ae7343-f2a5-49a2-8143-87539cee87b0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Created reservations ['a6bab0c6-6c5b-4086-99e3-04eb506512e6', '22f0ddc9-aed7-4ebf-b617-516ff7cd88c0', '026724b7-f08e-4c63-aeff-f1ae73876f56', '6b82c299-47f1-4eb0-8067-a6a7e05aeca5'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:48 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc Nov 02 10:20:48 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:48 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:48 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:49 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.322s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Deleted volume successfully. Nov 02 10:20:49 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc" returned: 0 in 0.520s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b5421e71-10e5-4c94-9f61-4d07c0430226 tempest-VolumeAndVolumeTypeFromImageTest-657608026 None] Lock "cinder-9bee361b-46c8-4c4c-a027-26db9f103ad0-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:49 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc Nov 02 10:20:49 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:49 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-41cf78f5-23f3-4874-a9a4-536a46422afc" returned: 0 in 0.326s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-41cf78f5-23f3-4874-a9a4-536a46422afc" released by "delete_volume" :: held 0.912s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-71961e91-6889-4870-ba10-092a3141e57b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-71961e91-6889-4870-ba10-092a3141e57b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created reservations ['e091b703-f2b9-419d-a61c-6d63a207439b', '87419eb2-2bf2-470a-934a-c8220a32ac90', 'de154feb-d2d3-4f12-a045-8f70771fa914', '01b20a75-6e15-42de-9df2-4616a038da70'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-quobyte-71961e91-6889-4870-ba10-092a3141e57b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-71961e91-6889-4870-ba10-092a3141e57b" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c753d045-29c0-4f2d-b232-b122d18f45c7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:49 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:49 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b Nov 02 10:20:50 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.331s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:50 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Deleted volume successfully. Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1053a68b-8a60-4f14-b9bd-775b3b4bb0d1 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-41cf78f5-23f3-4874-a9a4-536a46422afc-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:50 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b" returned: 0 in 0.475s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:50 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b Nov 02 10:20:50 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-71961e91-6889-4870-ba10-092a3141e57b" returned: 0 in 0.324s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-71961e91-6889-4870-ba10-092a3141e57b" released by "delete_volume" :: held 0.865s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created reservations ['2551c9b5-549c-42eb-b054-d65766f01848', '22215312-9c4f-415e-a954-baf4eedd6228', 'e28c0289-c942-4419-ac99-f0a4883aecb3', 'd5bbe545-ce0a-4a50-a42d-9f6ab1b7ae9a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:50 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:50 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-40941bb1-548a-4d97-8978-4df066013e6a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-40941bb1-548a-4d97-8978-4df066013e6a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-quobyte-40941bb1-548a-4d97-8978-4df066013e6a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-40941bb1-548a-4d97-8978-4df066013e6a" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a553bec-9214-4461-ac92-f1077f74e451]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:51 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.395s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:51 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Deleted volume successfully. Nov 02 10:20:51 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a Nov 02 10:20:51 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-05ba1394-6327-406a-9ad3-af56ba3028a8 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-71961e91-6889-4870-ba10-092a3141e57b-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:51 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a" returned: 0 in 0.475s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:51 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a Nov 02 10:20:51 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Flow 'volume_create_manager' (68219301-309a-4077-9914-3f4465021c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45daf12-c379-4c12-9b73-2626c0838534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45daf12-c379-4c12-9b73-2626c0838534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639694cc-4255-4cd6-a77d-11b504da60e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33201f43eef34bd793c2780a692b9ffd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:52Z,use_quota=True,user_id='87a942a6d18647ed93b78f36cd62330e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbc9907-da09-45f1-9f9a-c20540dfe5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbc9907-da09-45f1-9f9a-c20540dfe5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5be16b-aa1e-45c0-820b-d150970a356d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5be16b-aa1e-45c0-820b-d150970a356d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639694cc-4255-4cd6-a77d-11b504da60e1', 'volume_name': 'volume-639694cc-4255-4cd6-a77d-11b504da60e1', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1ad740-2699-477b-b072-1ea104fb1be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1ad740-2699-477b-b072-1ea104fb1be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f14ae7-7b31-4718-86df-2d33712707e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:51 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Volume 639694cc-4255-4cd6-a77d-11b504da60e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639694cc-4255-4cd6-a77d-11b504da60e1', 'volume_size': 1} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639694cc-4255-4cd6-a77d-11b504da60e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33201f43eef34bd793c2780a692b9ffd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:52Z,use_quota=True,user_id='87a942a6d18647ed93b78f36cd62330e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Creating volume 639694cc-4255-4cd6-a77d-11b504da60e1 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:51 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:51 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1 1073741824 Nov 02 10:20:51 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:51 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-40941bb1-548a-4d97-8978-4df066013e6a" returned: 0 in 0.324s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-5d298e7e-da4b-4f2a-aad5-29e928caa1e7-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-40941bb1-548a-4d97-8978-4df066013e6a" released by "delete_volume" :: held 0.876s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-5d298e7e-da4b-4f2a-aad5-29e928caa1e7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-quobyte-5d298e7e-da4b-4f2a-aad5-29e928caa1e7" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created reservations ['ab52c0ee-8d0b-4e74-b64b-d3a0f91030d8', 'dc88bca1-b28e-404f-be59-6cca21077cb5', '2301430e-6366-4b49-a60a-0a6a54e29598', '87f63fda-7724-4cfa-9654-74a54a9832ec'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-5d298e7e-da4b-4f2a-aad5-29e928caa1e7" acquired by "delete_volume" :: waited 0.045s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[496612be-7130-4fc4-b261-d7de90b088a3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:52 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:52 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:52 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 Nov 02 10:20:52 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:52 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1 1073741824" returned: 0 in 0.608s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:52 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1 Nov 02 10:20:52 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:52 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.273s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Deleted volume successfully. Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2302bb93-38c6-4491-947c-567fac78a5b4 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-40941bb1-548a-4d97-8978-4df066013e6a-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:52 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7" returned: 0 in 0.516s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:52 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7 Nov 02 10:20:52 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:52 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1" returned: 0 in 0.310s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f14ae7-7b31-4718-86df-2d33712707e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639694cc-4255-4cd6-a77d-11b504da60e1', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922b3461-69bd-46ab-9bdb-efc25a81594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:52 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Volume volume-639694cc-4255-4cd6-a77d-11b504da60e1 (639694cc-4255-4cd6-a77d-11b504da60e1): created successfully Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922b3461-69bd-46ab-9bdb-efc25a81594b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:52 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Flow 'volume_create_manager' (68219301-309a-4077-9914-3f4465021c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:52 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a9ee779f-c4f5-473e-8cfc-1e192f6bda81 tempest-CinderUnicodeTest-1040244545 None] Created volume successfully. Nov 02 10:20:53 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-5d298e7e-da4b-4f2a-aad5-29e928caa1e7" returned: 0 in 0.298s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-5d298e7e-da4b-4f2a-aad5-29e928caa1e7" released by "delete_volume" :: held 0.874s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created reservations ['1c8edbcd-92bd-462f-bc47-2111ea303f6e', '8ab9be3c-8bdd-4878-a647-a7c2a29d364f', 'ffce9487-ebab-4b09-ac5f-6dd4ba243c56', '8349f7d3-310a-4fb1-a3f5-a662b0f908f9'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:53 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:53 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-f4b79c22-328e-41e5-a991-a5f519188ba7-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-f4b79c22-328e-41e5-a991-a5f519188ba7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-quobyte-f4b79c22-328e-41e5-a991-a5f519188ba7" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-f4b79c22-328e-41e5-a991-a5f519188ba7" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:53 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.277s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:53 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Deleted volume successfully. Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f31343-a5bc-4715-abb5-5475936df279]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-30650f47-4fe4-49fc-9d2d-b64dcd0bdfab tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-5d298e7e-da4b-4f2a-aad5-29e928caa1e7-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:53 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7 Nov 02 10:20:53 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:53 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7" returned: 0 in 0.414s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:53 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7 Nov 02 10:20:53 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:54 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-f4b79c22-328e-41e5-a991-a5f519188ba7" returned: 0 in 0.275s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-f4b79c22-328e-41e5-a991-a5f519188ba7" released by "delete_volume" :: held 0.763s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created reservations ['790cc7eb-d26e-47da-9ae3-e165c0eb41ac', '2cf08b92-a0b3-4988-bddf-803bfc4ec0dd', '4dfb5d4d-3ae1-4717-b65f-c92555638246', '0d291525-f23d-4b83-a2d2-0a461746efab'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-2d0c124f-5400-4d2b-b582-631fec998b2b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-2d0c124f-5400-4d2b-b582-631fec998b2b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-quobyte-2d0c124f-5400-4d2b-b582-631fec998b2b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:54 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:54 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-2d0c124f-5400-4d2b-b582-631fec998b2b" acquired by "delete_volume" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[534c97d9-af58-4ab4-850b-95b81df18e09]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Flow 'volume_create_manager' (8b5c19ae-da3f-4f2b-adeb-82dd798423d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b082c3a7-c763-42f2-8568-b86d82ce9792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:54 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b Nov 02 10:20:54 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b082c3a7-c763-42f2-8568-b86d82ce9792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1738100535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a9ac51-e40f-4dd9-b943-1b10f1179b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33201f43eef34bd793c2780a692b9ffd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:55Z,use_quota=True,user_id='87a942a6d18647ed93b78f36cd62330e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3112e300-fc60-43e5-a722-a334e5a8cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3112e300-fc60-43e5-a722-a334e5a8cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877a2ea6-a903-48f9-968b-10530e164bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877a2ea6-a903-48f9-968b-10530e164bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a9ac51-e40f-4dd9-b943-1b10f1179b8a', 'volume_name': 'volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990ebb25-339a-45a1-83fe-64eac340d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990ebb25-339a-45a1-83fe-64eac340d078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd709b9-7387-4637-95da-400d4d52123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:54 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Volume c7a9ac51-e40f-4dd9-b943-1b10f1179b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a', 'volume_size': 1} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:20:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1738100535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a9ac51-e40f-4dd9-b943-1b10f1179b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33201f43eef34bd793c2780a692b9ffd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:55Z,use_quota=True,user_id='87a942a6d18647ed93b78f36cd62330e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Creating volume c7a9ac51-e40f-4dd9-b943-1b10f1179b8a {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:20:54 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:54 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.365s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:54 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a 1073741824 Nov 02 10:20:54 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:54 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Deleted volume successfully. Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "cinder-quobyte-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-fed98d68-63ee-4805-8d32-8a25eecc7c65 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-f4b79c22-328e-41e5-a991-a5f519188ba7-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1976e74-3d09-41ce-85c4-41e182cc9acf]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:55 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b" returned: 0 in 0.450s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:55 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 Nov 02 10:20:55 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b Nov 02 10:20:55 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:55 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:55 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a 1073741824" returned: 0 in 0.540s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:55 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-2d0c124f-5400-4d2b-b582-631fec998b2b" returned: 0 in 0.316s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:55 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808" returned: 0 in 0.433s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-2d0c124f-5400-4d2b-b582-631fec998b2b" released by "delete_volume" :: held 0.863s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:55 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808 Nov 02 10:20:55 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:55 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a Nov 02 10:20:55 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created reservations ['14fa89a3-27ff-4c8e-a866-d38aacaf1cd3', '05806487-e5b2-4ca7-b91c-3065f2b4a98e', 'd66003cc-c282-4dd0-86f8-d15b428b011e', 'bbac58c3-f99d-4492-8888-862f3c052cf3'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:55 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:55 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:55 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808" returned: 0 in 0.355s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-quobyte-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808" released by "delete_volume" :: held 0.851s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:55 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" returned: 0 in 0.395s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd709b9-7387-4637-95da-400d4d52123b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25e7f21-34da-4635-b53c-00599340c91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:20:55 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Volume volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a (c7a9ac51-e40f-4dd9-b943-1b10f1179b8a): created successfully Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25e7f21-34da-4635-b53c-00599340c91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Flow 'volume_create_manager' (8b5c19ae-da3f-4f2b-adeb-82dd798423d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Created reservations ['01710be0-3fb4-4153-97c9-b1c407bef367', 'dbc1f5ed-e22c-4fae-ad6c-f1a734dd06a4', 'a1891077-430c-41d2-8070-5c534d9e5107', 'f8f2a628-b9d6-4acd-a885-dcb8bac77a7c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5a9ab1dd-f1dc-4574-8443-4621cce8a65f tempest-CinderUnicodeTest-1040244545 None] Created volume successfully. Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:55 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:55 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:55 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.357s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:55 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Deleted volume successfully. Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-84d6dc58-c8da-48d6-a3be-5f05991a529b tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-2d0c124f-5400-4d2b-b582-631fec998b2b-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:56 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.258s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:56 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Deleted volume successfully. Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-897a3ee2-4553-4279-b6b0-56c99a37f313 tempest-CreateVolumesFromSourceVolumeTest-1477945896 None] Lock "cinder-22d6f29c-ba5b-4ad2-b308-2aa10ffc2808-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-fa67c3cd-48e6-4f61-b106-992d7145d1be-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-fa67c3cd-48e6-4f61-b106-992d7145d1be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-quobyte-fa67c3cd-48e6-4f61-b106-992d7145d1be" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-fa67c3cd-48e6-4f61-b106-992d7145d1be" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b6b8e-8662-4f2d-b8c5-20e423db2c6b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Creating offline snapshot 9dd73ffb-c678-47e5-b7aa-706b08d416cc of volume c7a9ac51-e40f-4dd9-b943-1b10f1179b8a {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[14621b22-0f95-47b4-b3c7-b0e8d9f2e216]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:56 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be Nov 02 10:20:56 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:57 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a Nov 02 10:20:57 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:57 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be" returned: 0 in 0.456s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:57 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be Nov 02 10:20:57 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:57 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" returned: 0 in 0.440s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:57 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc 1G Nov 02 10:20:57 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:57 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-fa67c3cd-48e6-4f61-b106-992d7145d1be" returned: 0 in 0.369s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-fa67c3cd-48e6-4f61-b106-992d7145d1be" released by "delete_volume" :: held 0.897s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created reservations ['8a3a5dc0-e9fe-4011-96fc-062c7d13bbcb', 'f2ca9d77-f425-4553-b2ef-30c444e014cc', '82995dec-efe7-4b33-a4d8-a5eb8cfde7f8', 'be968e2f-7a96-47ef-877c-ec5e63a190e8'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:58 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:20:58 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:58 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc 1G" returned: 0 in 0.699s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:58 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc Nov 02 10:20:58 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:58 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.351s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:20:58 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Deleted volume successfully. Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-6799ce08-b385-4232-bddc-f4c5bf3a2274 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-fa67c3cd-48e6-4f61-b106-992d7145d1be-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:58 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc" returned: 0 in 0.404s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:58 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc is being set with open permissions: ugo+rw Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:58 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc Nov 02 10:20:58 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:58 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc" returned: 0 in 0.303s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:58 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.info Nov 02 10:20:58 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:58 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-69182acc-9d9a-413a-abf9-d7fbcc4accfd-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-69182acc-9d9a-413a-abf9-d7fbcc4accfd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-quobyte-69182acc-9d9a-413a-abf9-d7fbcc4accfd" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-69182acc-9d9a-413a-abf9-d7fbcc4accfd" acquired by "delete_volume" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[079bd42d-158f-4614-9fe2-0ba9247515dd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:59 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.info" returned: 0 in 0.314s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:59 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.info is being set with open permissions: ugo+rw Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:59 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.info Nov 02 10:20:59 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:59 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd Nov 02 10:20:59 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:59 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.info" returned: 0 in 0.277s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:20:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b190d168-d279-44c9-8ee9-ca1a511ed4be tempest-CinderUnicodeTest-1040244545 None] Create snapshot completed successfully Nov 02 10:20:59 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd" returned: 0 in 0.461s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:20:59 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd Nov 02 10:20:59 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:20:59 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-69182acc-9d9a-413a-abf9-d7fbcc4accfd" returned: 0 in 0.273s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-69182acc-9d9a-413a-abf9-d7fbcc4accfd" released by "delete_volume" :: held 0.794s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:20:59 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created reservations ['c18288a1-319b-46dc-8de9-c0f744e02231', '3aa74635-7c42-40f7-abc4-662e6aec8189', 'd58dd9db-dbe1-4910-a72b-643e4d668201', 'a80e1951-1fa2-4e24-946b-1a6b1b258080'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:00 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:00 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "cinder-9dd73ffb-c678-47e5-b7aa-706b08d416cc-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-9dd73ffb-c678-47e5-b7aa-706b08d416cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "cinder-quobyte-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-quobyte-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "cinder-quobyte-9dd73ffb-c678-47e5-b7aa-706b08d416cc" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-07610b9d-65c9-4e4b-a5f8-0fe51350f983-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-quobyte-9dd73ffb-c678-47e5-b7aa-706b08d416cc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Deleting offline snapshot 9dd73ffb-c678-47e5-b7aa-706b08d416cc of volume c7a9ac51-e40f-4dd9-b943-1b10f1179b8a {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] snapshot_file for this snap is: volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-07610b9d-65c9-4e4b-a5f8-0fe51350f983-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-quobyte-cd75d174-198f-479b-b4a0-5a7c32afa082" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[51deb409-c03d-4a86-b1be-87d38d75a386]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-cd75d174-198f-479b-b4a0-5a7c32afa082" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-quobyte-07610b9d-65c9-4e4b-a5f8-0fe51350f983" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-07610b9d-65c9-4e4b-a5f8-0fe51350f983" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Deleting offline snapshot 07610b9d-65c9-4e4b-a5f8-0fe51350f983 of volume cd75d174-198f-479b-b4a0-5a7c32afa082 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] snapshot_file for this snap is: volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:00 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.418s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1f2b4f-e502-4195-9372-4d97cf9bfdea]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Deleted volume successfully. Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1af8d6de-228b-48af-acfb-78ae8c7e4118 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-69182acc-9d9a-413a-abf9-d7fbcc4accfd-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:00 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc Nov 02 10:21:00 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:00 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 Nov 02 10:21:00 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:00 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc" returned: 0 in 0.535s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[827ce8b0-0a54-485d-9803-c1170fa3d9eb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:00 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983" returned: 0 in 0.488s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd75d174-198f-479b-b4a0-5a7c32afa082(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0fe13e-3895-44b5-bf2f-1d9ea7654462]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a Nov 02 10:21:01 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 Nov 02 10:21:01 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Flow 'volume_create_manager' (2512425e-423b-436f-8678-1d845a1f765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dea809-cb9a-47f5-9405-bc85c08307d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dea809-cb9a-47f5-9405-bc85c08307d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1863058231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd78062-fecb-43e3-9f0d-1b2a8173496e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2081bb500bd54b7ebd427beba6322623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:01Z,use_quota=True,user_id='5df976e0f4b24ccc9d21755d1ee4c225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2946d49-8ccc-40f3-8266-d0f3ce60aca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2946d49-8ccc-40f3-8266-d0f3ce60aca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd92566f-ea2f-47d1-bb0b-6f4f002b0625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd92566f-ea2f-47d1-bb0b-6f4f002b0625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd78062-fecb-43e3-9f0d-1b2a8173496e', 'volume_name': 'volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89db7d5a-b2ed-476f-a4cd-302d66120a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89db7d5a-b2ed-476f-a4cd-302d66120a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d7117a-16ad-4eb5-a682-5c1b3c085efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:01 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Volume 7cd78062-fecb-43e3-9f0d-1b2a8173496e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e', 'volume_size': 1} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1863058231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd78062-fecb-43e3-9f0d-1b2a8173496e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2081bb500bd54b7ebd427beba6322623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:01Z,use_quota=True,user_id='5df976e0f4b24ccc9d21755d1ee4c225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Creating volume 7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:01 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e 1073741824 Nov 02 10:21:01 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" returned: 0 in 0.677s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc Nov 02 10:21:01 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:01 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082" returned: 0 in 0.711s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:01 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 Nov 02 10:21:01 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:02 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc" returned: 0 in 0.469s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:02 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc Nov 02 10:21:02 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:02 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e 1073741824" returned: 0 in 0.623s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:02 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e Nov 02 10:21:02 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:02 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983" returned: 0 in 0.531s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:02 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983 Nov 02 10:21:02 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:02 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a.9dd73ffb-c678-47e5-b7aa-706b08d416cc" returned: 0 in 0.415s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e" returned: 0 in 0.356s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-quobyte-9dd73ffb-c678-47e5-b7aa-706b08d416cc" released by "_delete_snapshot" :: held 2.285s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-quobyte-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" released by "delete_snapshot" :: held 2.326s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d7117a-16ad-4eb5-a682-5c1b3c085efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e390b505-724a-4bbe-9b65-e08bf781c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:02 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Volume volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e (7cd78062-fecb-43e3-9f0d-1b2a8173496e): created successfully Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e390b505-724a-4bbe-9b65-e08bf781c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Flow 'volume_create_manager' (2512425e-423b-436f-8678-1d845a1f765b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0c783710-1dc9-4a55-b518-a5db912ce6b5 tempest-VolumeDependencyTests-1438457396 None] Created volume successfully. Nov 02 10:21:02 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082.07610b9d-65c9-4e4b-a5f8-0fe51350f983" returned: 0 in 0.399s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Created reservations ['ad9fa206-041f-40bc-8941-4aa3e32dc8cd', '1badb52b-0181-4a32-9dce-bb9736878bea', '22f981e1-be84-4f08-aa2f-0e4efed17aa4', '679ecea6-44de-4e6b-a3d8-c6e974801040'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-07610b9d-65c9-4e4b-a5f8-0fe51350f983" released by "_delete_snapshot" :: held 2.315s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-cd75d174-198f-479b-b4a0-5a7c32afa082" released by "delete_snapshot" :: held 2.353s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Delete snapshot completed successfully. Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9f0813fd-efca-40c1-8edb-8cc910f23a42 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-9dd73ffb-c678-47e5-b7aa-706b08d416cc-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created reservations ['bc92e564-c359-4615-830c-a8548b6c02c6', 'f66db2b5-dd3a-4daa-b161-68a8edb820e1', '205b82f5-ac09-4765-880d-88101c86943d', 'c02cc16a-a3b7-4093-b6d0-66e9ada21240'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Delete snapshot completed successfully. Nov 02 10:21:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ccda708d-3372-49a5-9893-acca694bea34 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-07610b9d-65c9-4e4b-a5f8-0fe51350f983-delete_snapshot" released by "delete_snapshot" :: held 2.573s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "cinder-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "cinder-quobyte-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-quobyte-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4026461-3700-40b8-842c-71524149270a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-cd75d174-198f-479b-b4a0-5a7c32afa082-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-cd75d174-198f-479b-b4a0-5a7c32afa082-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "cinder-quobyte-cd75d174-198f-479b-b4a0-5a7c32afa082" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Creating offline snapshot d45442ba-e2ed-422a-8624-a00eecb43f3f of volume 7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:03 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-cd75d174-198f-479b-b4a0-5a7c32afa082" acquired by "delete_volume" :: waited 0.040s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:03 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e82d2e-3231-4489-bbe2-e123b0e40faf]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f5ed1b-62dc-4045-bd50-3092fb13d59f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:04 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 Nov 02 10:21:04 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e Nov 02 10:21:04 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" returned: 0 in 0.516s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:04 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a Nov 02 10:21:04 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e" returned: 0 in 0.518s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:04 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082" returned: 0 in 0.515s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:04 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f 1G Nov 02 10:21:04 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082 Nov 02 10:21:04 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" returned: 0 in 0.354s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-quobyte-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a" released by "delete_volume" :: held 0.985s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Created reservations ['c42b7596-af0a-4bfa-a1d1-e700b7678072', '3ea5757d-772c-41f8-8745-c2f41e3a7ace', '40d2c736-177e-4cfd-8564-dc55ec1d4637', '346c8b77-53c6-4f70-9be3-89cfe0f28036'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:04 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-cd75d174-198f-479b-b4a0-5a7c32afa082" returned: 0 in 0.378s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:04 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:04 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-quobyte-cd75d174-198f-479b-b4a0-5a7c32afa082" released by "delete_volume" :: held 0.978s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Created reservations ['5dd2cfc2-abce-409c-8ba4-14f3e8c09044', 'e095a0da-4fc2-4581-a1d9-4aa090d5d524', 'a8c5fee9-ab27-484d-b1d9-cb873748946f', '9df73e40-48b2-4cc9-9260-14459235d720'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:05 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:05 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:05 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f 1G" returned: 0 in 0.725s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:05 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.370s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:05 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Deleted volume successfully. Nov 02 10:21:05 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f Nov 02 10:21:05 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-45612bd8-b685-49c5-87b3-5670f19a4331 tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-c7a9ac51-e40f-4dd9-b943-1b10f1179b8a-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:05 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.343s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:05 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Deleted volume successfully. Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7098e4f1-9fb1-4545-8496-25a3b5677651 tempest-CreateVolumesFromSnapshotTest-1934916656 None] Lock "cinder-cd75d174-198f-479b-b4a0-5a7c32afa082-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:05 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f" returned: 0 in 0.399s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:05 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f is being set with open permissions: ugo+rw Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:05 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f Nov 02 10:21:05 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:05 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f" returned: 0 in 0.278s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "cinder-639694cc-4255-4cd6-a77d-11b504da60e1-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:06 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.info Nov 02 10:21:06 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-639694cc-4255-4cd6-a77d-11b504da60e1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "cinder-quobyte-639694cc-4255-4cd6-a77d-11b504da60e1" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-quobyte-639694cc-4255-4cd6-a77d-11b504da60e1" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[81baf051-106a-4b56-bc90-6beb42fd14e7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:06 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1 Nov 02 10:21:06 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:06 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.info" returned: 0 in 0.391s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:06 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.info is being set with open permissions: ugo+rw Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:06 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.info Nov 02 10:21:06 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:06 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1" returned: 0 in 0.525s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:06 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1 Nov 02 10:21:06 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:06 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.info" returned: 0 in 0.357s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.830s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ecbb014b-5044-432d-a283-126eb09b5097 tempest-VolumeDependencyTests-1438457396 None] Create snapshot completed successfully Nov 02 10:21:07 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-639694cc-4255-4cd6-a77d-11b504da60e1" returned: 0 in 0.375s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-quobyte-639694cc-4255-4cd6-a77d-11b504da60e1" released by "delete_volume" :: held 0.988s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Created reservations ['16f55edc-1704-44d2-bb5f-590e137b035a', 'afda1419-f209-46e0-95a4-8269c3d98d11', '3c554347-be08-4498-bc0f-c9a90f412e35', 'b5dac310-3bd6-4c5f-99d4-abb62717bbcb'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:07 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:07 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:07 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.371s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Deleted volume successfully. Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55874fa5-77c8-4197-9e15-9c9d4dd823fb tempest-CinderUnicodeTest-1040244545 None] Lock "cinder-639694cc-4255-4cd6-a77d-11b504da60e1-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Flow 'volume_create_manager' (af1324b9-86d3-48fc-a4e2-c3f53c275c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07725f71-aba1-4dd4-bb59-4dc8b9901d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07725f71-aba1-4dd4-bb59-4dc8b9901d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1147225454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21153680-b812-4593-8caf-706dbbc7f5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2081bb500bd54b7ebd427beba6322623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d45442ba-e2ed-422a-8624-a00eecb43f3f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:08Z,use_quota=True,user_id='5df976e0f4b24ccc9d21755d1ee4c225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e351c77c-a6e8-4275-8391-e2f685c799df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e351c77c-a6e8-4275-8391-e2f685c799df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1cc311-5a19-4609-8ef6-9659112c6221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1cc311-5a19-4609-8ef6-9659112c6221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '21153680-b812-4593-8caf-706dbbc7f5e7', 'volume_name': 'volume-21153680-b812-4593-8caf-706dbbc7f5e7', 'volume_size': 1, 'snapshot_id': 'd45442ba-e2ed-422a-8624-a00eecb43f3f'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3aff98a-8686-49e6-a3aa-7be8623525e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3aff98a-8686-49e6-a3aa-7be8623525e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e745fd9-b7cf-407e-b8d3-c2d45824219b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:07 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Volume 21153680-b812-4593-8caf-706dbbc7f5e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-21153680-b812-4593-8caf-706dbbc7f5e7', 'volume_size': 1, 'snapshot_id': 'd45442ba-e2ed-422a-8624-a00eecb43f3f'} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "cinder-quobyte-d45442ba-e2ed-422a-8624-a00eecb43f3f-21153680-b812-4593-8caf-706dbbc7f5e7" by "_create_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-d45442ba-e2ed-422a-8624-a00eecb43f3f-21153680-b812-4593-8caf-706dbbc7f5e7" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Creating volume 21153680-b812-4593-8caf-706dbbc7f5e7 from snapshot d45442ba-e2ed-422a-8624-a00eecb43f3f {{(pid=86840) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "cinder-quobyte-21153680-b812-4593-8caf-706dbbc7f5e7" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-21153680-b812-4593-8caf-706dbbc7f5e7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] snapshot: d45442ba-e2ed-422a-8624-a00eecb43f3f, volume: 21153680-b812-4593-8caf-706dbbc7f5e7, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a66d5e-347e-437f-be31-8b047a28717b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:08 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f Nov 02 10:21:08 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:08 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f" returned: 0 in 0.563s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5c8e4c-6408-4130-82b2-6d28a7157ffe]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:08 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e Nov 02 10:21:08 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:09 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e" returned: 0 in 0.485s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:21:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:21:09 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:21:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:09 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 Nov 02 10:21:09 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:17 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Flow 'volume_create_manager' (3e7a0258-c68f-42ab-8c6c-2b2dfb70b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282c540b-bf57-4041-b06b-aa321062b483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282c540b-bf57-4041-b06b-aa321062b483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8edfe2-aa2a-4a66-8e80-123517527056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949d6073856e422587ee67cb8a0be322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:18Z,use_quota=True,user_id='eda5b414fb9944d387cbc4ab60f6073d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1df139-bc50-4d6d-a049-463cb28b98f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1df139-bc50-4d6d-a049-463cb28b98f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d183bf40-510b-4d77-9e6f-43b79cd4f518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:17 devstack cinder-volume[86840]: DEBUG cinder.image.glance [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Creating Keystone auth plugin from conf {{(pid=86840) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:21:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d183bf40-510b-4d77-9e6f-43b79cd4f518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb8edfe2-aa2a-4a66-8e80-123517527056', 'volume_name': 'volume-bb8edfe2-aa2a-4a66-8e80-123517527056', 'volume_size': 1, 'image_id': '8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '944c96e837d57a87442965a675ea71a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '949d6073856e422587ee67cb8a0be322', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a64b79d1a1e0c08f0ddee4dbf3b833a7875b20b44f8d74b50b0a9607276cc4ab2fda235494941db6bca0f1e562e5f920adf146f38cb88501d285c948e72cecb', 'id': '8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'created_at': datetime.datetime(2026, 11, 2, 9, 21, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 21, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ad28fb8-4c89-4861-9ad6-789551fafc5f/file', 'properties': {}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616f8870-d5c0-4f64-881d-09372cf46407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616f8870-d5c0-4f64-881d-09372cf46407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2cb4d3-2b97-48c6-880e-213173a13d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:18 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Volume bb8edfe2-aa2a-4a66-8e80-123517527056: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb8edfe2-aa2a-4a66-8e80-123517527056', 'volume_size': 1, 'image_id': '8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '944c96e837d57a87442965a675ea71a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '949d6073856e422587ee67cb8a0be322', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a64b79d1a1e0c08f0ddee4dbf3b833a7875b20b44f8d74b50b0a9607276cc4ab2fda235494941db6bca0f1e562e5f920adf146f38cb88501d285c948e72cecb', 'id': '8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'created_at': datetime.datetime(2026, 11, 2, 9, 21, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 21, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ad28fb8-4c89-4861-9ad6-789551fafc5f/file', 'properties': {}}, 'image_service': } Nov 02 10:21:18 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Trying to clone bb8edfe2-aa2a-4a66-8e80-123517527056 from image 8ad28fb8-4c89-4861-9ad6-789551fafc5f at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'metadata': {}}]). {{(pid=86840) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:21:19 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7" returned: 0 in 9.898s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:21:19 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Converted 1024.00 MB image at 103.44 MB/s Nov 02 10:21:19 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 is being set with open permissions: ugo+rw Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 10:21:19 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Image download 0.00 MB at 0.00 MB/s Nov 02 10:21:19 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 Nov 02 10:21:19 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14f4e7c-7af9-46a9-85ec-b94f4848681e]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:19 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD Nov 02 10:21:19 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:19 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7" returned: 0 in 0.337s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-21153680-b812-4593-8caf-706dbbc7f5e7" released by "_copy_volume_from_snapshot" :: held 11.399s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-d45442ba-e2ed-422a-8624-a00eecb43f3f-21153680-b812-4593-8caf-706dbbc7f5e7" released by "_create_volume_from_snapshot" :: held 11.520s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.542s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e745fd9-b7cf-407e-b8d3-c2d45824219b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21153680-b812-4593-8caf-706dbbc7f5e7', 'volume_size': 1, 'snapshot_id': 'd45442ba-e2ed-422a-8624-a00eecb43f3f'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb28864e-300f-401d-8b8d-87e531f30068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:19 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Volume volume-21153680-b812-4593-8caf-706dbbc7f5e7 (21153680-b812-4593-8caf-706dbbc7f5e7): created successfully Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb28864e-300f-401d-8b8d-87e531f30068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:19 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Flow 'volume_create_manager' (af1324b9-86d3-48fc-a4e2-c3f53c275c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-74c0ec3e-a5cf-469c-a285-b39a6c4b5dbf tempest-VolumeDependencyTests-1438457396 None] Created volume successfully. Nov 02 10:21:19 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD Nov 02 10:21:19 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD" returned: 1 in 0.419s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Temporary image 8ad28fb8-4c89-4861-9ad6-789551fafc5f is fetched for user eda5b414fb9944d387cbc4ab60f6073d. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1492773-06f4-453a-996e-8805b0d4dd67]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:20 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD Nov 02 10:21:20 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "cinder-d45442ba-e2ed-422a-8624-a00eecb43f3f-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-d45442ba-e2ed-422a-8624-a00eecb43f3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "cinder-quobyte-7cd78062-fecb-43e3-9f0d-1b2a8173496e" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-7cd78062-fecb-43e3-9f0d-1b2a8173496e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "cinder-quobyte-d45442ba-e2ed-422a-8624-a00eecb43f3f" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-d45442ba-e2ed-422a-8624-a00eecb43f3f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Deleting offline snapshot d45442ba-e2ed-422a-8624-a00eecb43f3f of volume 7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:20 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] snapshot_file for this snap is: volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[409ff6eb-4b4c-4479-89f9-a5ed100c73c0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:20 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f Nov 02 10:21:20 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD Nov 02 10:21:20 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:20 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:20 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:20 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD" returned: 1 in 0.425s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8edfe2-aa2a-4a66-8e80-123517527056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949d6073856e422587ee67cb8a0be322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:18Z,use_quota=True,user_id='eda5b414fb9944d387cbc4ab60f6073d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Creating volume bb8edfe2-aa2a-4a66-8e80-123517527056 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:20 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:21 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 1073741824 Nov 02 10:21:21 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:21 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f" returned: 0 in 0.527s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[327ad1d7-ef3b-4eff-b20b-4c4921ba7d7e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:21 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.379s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:21:21 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e Nov 02 10:21:21 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:21 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 1073741824" returned: 0 in 0.627s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:21 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 Nov 02 10:21:21 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:21 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e" returned: 0 in 0.738s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:21 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f Nov 02 10:21:21 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:22 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056" returned: 0 in 0.356s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=236,cinder:SELECT=183,cinder:DELETE=22,cinder:INSERT=60 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=169,cinder:INSERT=65,cinder:UPDATE=255,cinder:DELETE=23 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Attempting download of 8ad28fb8-4c89-4861-9ad6-789551fafc5f ((None, [{'url': 'file:///opt/stack/data/glance/images/8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'metadata': {}}])) to volume bb8edfe2-aa2a-4a66-8e80-123517527056. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc102b5a-d2ce-4cf9-8a99-0689fcd9581f]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ad28fb8-4c89-4861-9ad6-789551fafc5f_yhpy9bff {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:22 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ad28fb8-4c89-4861-9ad6-789551fafc5f_yhpy9bff Nov 02 10:21:22 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:22 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f" returned: 0 in 0.550s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:22 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f Nov 02 10:21:22 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:22 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ad28fb8-4c89-4861-9ad6-789551fafc5f_yhpy9bff" returned: 0 in 0.523s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ad28fb8-4c89-4861-9ad6-789551fafc5f_yhpy9bff {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:22 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e.d45442ba-e2ed-422a-8624-a00eecb43f3f" returned: 0 in 0.380s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:22 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ad28fb8-4c89-4861-9ad6-789551fafc5f_yhpy9bff Nov 02 10:21:22 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-d45442ba-e2ed-422a-8624-a00eecb43f3f" released by "_delete_snapshot" :: held 2.415s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-7cd78062-fecb-43e3-9f0d-1b2a8173496e" released by "delete_snapshot" :: held 2.455s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Created reservations ['a9b9fd76-147b-46a6-a71f-c6aeaa5f730c', '00f42c20-97c5-4a22-8ef6-59741c97c2c7', 'b86a5ddd-4d77-46dd-a5ee-5120a8e0c17b', '91a9bee8-7775-47d4-856e-e0c43af36182'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:23 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Delete snapshot completed successfully. Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4e7223df-4d2b-4b47-8f0a-c132a2c07d78 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-d45442ba-e2ed-422a-8624-a00eecb43f3f-delete_snapshot" released by "delete_snapshot" :: held 2.694s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:23 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ad28fb8-4c89-4861-9ad6-789551fafc5f_yhpy9bff" returned: 1 in 0.463s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ad28fb8-4c89-4861-9ad6-789551fafc5f_yhpy9bff' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edfd53b-1fab-4642-bcb7-ef9388ea0c4e]: (4, 'raw') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:23 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD Nov 02 10:21:23 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:23 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:23 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD Nov 02 10:21:23 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "cinder-7cd78062-fecb-43e3-9f0d-1b2a8173496e-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-7cd78062-fecb-43e3-9f0d-1b2a8173496e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "cinder-quobyte-7cd78062-fecb-43e3-9f0d-1b2a8173496e" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-7cd78062-fecb-43e3-9f0d-1b2a8173496e" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5773f207-b7ed-4f00-986d-76956582fa43]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:23 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD" returned: 1 in 0.407s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD' failed. Not Retrying. {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] 8ad28fb8-4c89-4861-9ad6-789551fafc5f was raw, converting to qcow2 {{(pid=86840) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 10:21:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:24 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 Nov 02 10:21:24 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:24 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e Nov 02 10:21:24 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:24 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e" returned: 0 in 0.476s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:24 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e Nov 02 10:21:24 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:24 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056" returned: 0 in 0.749s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:24 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ad28fb8-4c89-4861-9ad6-789551fafc5f_98wlt336devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:21:24 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 10:21:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:24 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 1G Nov 02 10:21:24 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:24 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-7cd78062-fecb-43e3-9f0d-1b2a8173496e" returned: 0 in 0.369s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-7cd78062-fecb-43e3-9f0d-1b2a8173496e" released by "delete_volume" :: held 0.946s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:24 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Created reservations ['7ecbb6b6-1502-4c0e-990b-1a0b155d23a7', '99a0c770-b1c5-404c-91e4-81a0bf7684bb', '0adb4a06-5cf1-4e40-9627-9026423675e7', 'b02474cd-88fc-4079-9bf0-61002cc6e8d2'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:25 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:25 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:25 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 1G" returned: 0 in 0.476s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Downloaded image 8ad28fb8-4c89-4861-9ad6-789551fafc5f ((None, [{'url': 'file:///opt/stack/data/glance/images/8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'metadata': {}}])) to volume bb8edfe2-aa2a-4a66-8e80-123517527056 successfully. {{(pid=86840) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Temporary image 8ad28fb8-4c89-4861-9ad6-789551fafc5f for user eda5b414fb9944d387cbc4ab60f6073d is deleted. {{(pid=86840) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.volume_utils [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Marking volume bb8edfe2-aa2a-4a66-8e80-123517527056 as bootable. {{(pid=86840) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Copying metadata from image 8ad28fb8-4c89-4861-9ad6-789551fafc5f to bb8edfe2-aa2a-4a66-8e80-123517527056. {{(pid=86840) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Creating volume glance metadata for volume bb8edfe2-aa2a-4a66-8e80-123517527056 backed by image 8ad28fb8-4c89-4861-9ad6-789551fafc5f with: {'image_id': '8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '944c96e837d57a87442965a675ea71a2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86840) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:21:25 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.330s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Deleted volume successfully. Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2cb4d3-2b97-48c6-880e-213173a13d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb8edfe2-aa2a-4a66-8e80-123517527056', 'volume_size': 1, 'image_id': '8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '944c96e837d57a87442965a675ea71a2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '949d6073856e422587ee67cb8a0be322', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a64b79d1a1e0c08f0ddee4dbf3b833a7875b20b44f8d74b50b0a9607276cc4ab2fda235494941db6bca0f1e562e5f920adf146f38cb88501d285c948e72cecb', 'id': '8ad28fb8-4c89-4861-9ad6-789551fafc5f', 'created_at': datetime.datetime(2026, 11, 2, 9, 21, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 21, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ad28fb8-4c89-4861-9ad6-789551fafc5f/file', 'properties': {}}, 'image_service': }' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c57be09-baa1-4fb6-9d0a-eee76b376c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:25 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Volume volume-bb8edfe2-aa2a-4a66-8e80-123517527056 (bb8edfe2-aa2a-4a66-8e80-123517527056): created successfully Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c57be09-baa1-4fb6-9d0a-eee76b376c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Flow 'volume_create_manager' (3e7a0258-c68f-42ab-8c6c-2b2dfb70b82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7523e4f8-371c-4020-a7ba-734910582a7a tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-7cd78062-fecb-43e3-9f0d-1b2a8173496e-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d6533bd6-fcf9-4f82-9948-d4a4fc23ce8e tempest-VolumeImageDependencyTests-217243159 None] Created volume successfully. Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "cinder-21153680-b812-4593-8caf-706dbbc7f5e7-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-21153680-b812-4593-8caf-706dbbc7f5e7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "cinder-quobyte-21153680-b812-4593-8caf-706dbbc7f5e7" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-21153680-b812-4593-8caf-706dbbc7f5e7" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c7613-01f3-4477-917d-733bc3da96eb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:26 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 Nov 02 10:21:26 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:26 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Acquiring lock "cinder-bb8edfe2-aa2a-4a66-8e80-123517527056-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7" returned: 0 in 0.540s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Lock "cinder-bb8edfe2-aa2a-4a66-8e80-123517527056-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:26 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7 Nov 02 10:21:26 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Acquiring lock "cinder-quobyte-bb8edfe2-aa2a-4a66-8e80-123517527056" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Lock "cinder-quobyte-bb8edfe2-aa2a-4a66-8e80-123517527056" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[523bcb62-eaa1-4861-962e-2eb4fba94e4f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:27 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 Nov 02 10:21:27 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Flow 'volume_create_manager' (a3d1c2fe-0f94-4602-a5bd-2d0bd5b6762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f62aad9-9bfa-4636-b9f7-fc5b159141a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-21153680-b812-4593-8caf-706dbbc7f5e7" returned: 0 in 0.383s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f62aad9-9bfa-4636-b9f7-fc5b159141a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-232031259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88edfa4b-9e04-432f-b1d1-a101906ef15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744de75e829f4fd48c33fa2ba5a061e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:27Z,use_quota=True,user_id='5a364047a4ab4d1b95c433aa24215fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a962afd-1044-43e1-8122-c3a85a791f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a962afd-1044-43e1-8122-c3a85a791f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677c2528-682d-49e2-b26b-ae01680b90e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677c2528-682d-49e2-b26b-ae01680b90e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88edfa4b-9e04-432f-b1d1-a101906ef15b', 'volume_name': 'volume-88edfa4b-9e04-432f-b1d1-a101906ef15b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab67eea-3b2b-42a1-a98a-9383eec4cc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab67eea-3b2b-42a1-a98a-9383eec4cc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578b36dd-46eb-4b9b-bf87-bd8af07e60cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:27 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Volume 88edfa4b-9e04-432f-b1d1-a101906ef15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88edfa4b-9e04-432f-b1d1-a101906ef15b', 'volume_size': 1} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-232031259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88edfa4b-9e04-432f-b1d1-a101906ef15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744de75e829f4fd48c33fa2ba5a061e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:27Z,use_quota=True,user_id='5a364047a4ab4d1b95c433aa24215fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Creating volume 88edfa4b-9e04-432f-b1d1-a101906ef15b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:27 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-quobyte-21153680-b812-4593-8caf-706dbbc7f5e7" released by "delete_volume" :: held 1.064s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:27 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b 1073741824 Nov 02 10:21:27 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Created reservations ['b90a59cf-7a40-434c-9666-97427719013f', '904b5f23-3ce3-48d1-982d-a70a039bdede', '12d7c787-ca20-4040-9344-3f512c4ffb7d', '3383478b-45cd-4bfc-82dd-20ac6659184a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:27 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056" returned: 0 in 0.530s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:27 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:27 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:27 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056 Nov 02 10:21:27 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:27 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b 1073741824" returned: 0 in 0.533s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.321s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:27 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Deleted volume successfully. Nov 02 10:21:27 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-bb8edfe2-aa2a-4a66-8e80-123517527056" returned: 0 in 0.333s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Lock "cinder-quobyte-bb8edfe2-aa2a-4a66-8e80-123517527056" released by "delete_volume" :: held 0.914s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-42021a80-ef02-4794-bbfe-fa1df33cd3a1 tempest-VolumeDependencyTests-1438457396 None] Lock "cinder-21153680-b812-4593-8caf-706dbbc7f5e7-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:27 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b Nov 02 10:21:27 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Created reservations ['06b4a2ac-5b19-4b55-b351-3364dcac8889', '8c52d877-7e07-4e84-9530-38b807db16ed', 'e8c93459-63b7-45c6-8f3b-e57e4bd7f805', '3d6cfd9d-347f-4f0b-ad74-fe8c7996ce5a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:28 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:28 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:28 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b" returned: 0 in 0.315s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578b36dd-46eb-4b9b-bf87-bd8af07e60cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88edfa4b-9e04-432f-b1d1-a101906ef15b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf283cac-be52-4dcf-8003-fe00d53bb397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:28 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Volume volume-88edfa4b-9e04-432f-b1d1-a101906ef15b (88edfa4b-9e04-432f-b1d1-a101906ef15b): created successfully Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf283cac-be52-4dcf-8003-fe00d53bb397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Flow 'volume_create_manager' (a3d1c2fe-0f94-4602-a5bd-2d0bd5b6762a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-85abb035-68ab-4cac-8f39-1edceda1a806 tempest-ProjectReaderTests-801863055 None] Created volume successfully. Nov 02 10:21:28 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.270s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Deleted volume successfully. Nov 02 10:21:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-2b67a5b0-da45-47e7-a254-03ff9305a822 tempest-VolumeImageDependencyTests-217243159 None] Lock "cinder-bb8edfe2-aa2a-4a66-8e80-123517527056-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Acquiring lock "cinder-88edfa4b-9e04-432f-b1d1-a101906ef15b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Lock "cinder-88edfa4b-9e04-432f-b1d1-a101906ef15b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Acquiring lock "cinder-quobyte-88edfa4b-9e04-432f-b1d1-a101906ef15b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Lock "cinder-quobyte-88edfa4b-9e04-432f-b1d1-a101906ef15b" acquired by "delete_volume" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:29 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6594b967-6eec-4e34-a2a9-45ebc9ef3a86]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:29 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b Nov 02 10:21:29 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:30 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b" returned: 0 in 0.420s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:30 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b Nov 02 10:21:30 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:30 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-88edfa4b-9e04-432f-b1d1-a101906ef15b" returned: 0 in 0.387s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Lock "cinder-quobyte-88edfa4b-9e04-432f-b1d1-a101906ef15b" released by "delete_volume" :: held 0.870s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Created reservations ['c9c6d14a-1a59-4425-9877-e755e24336a6', 'f9773c79-174d-4392-98ae-b8951d124277', '959bf5f0-20b4-4a18-b662-cc2b54bde0d3', '79611dd2-4055-4e70-b7b7-19685e01c611'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:30 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:30 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:31 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.344s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:31 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Deleted volume successfully. Nov 02 10:21:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f1362bbc-2eb2-4ca6-b93d-acee469683bb tempest-ProjectReaderTests-801863055 None] Lock "cinder-88edfa4b-9e04-432f-b1d1-a101906ef15b-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Flow 'volume_create_manager' (4b5063ba-ce01-422f-acbe-2de413bed48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a13d8e-7b14-48c7-a1da-877fea74dcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a13d8e-7b14-48c7-a1da-877fea74dcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830362213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affa6a7e-7493-4f02-a0b9-ececfd19f8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744de75e829f4fd48c33fa2ba5a061e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:32Z,use_quota=True,user_id='5a364047a4ab4d1b95c433aa24215fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941a955b-a65e-4c02-853d-3fe903d1f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941a955b-a65e-4c02-853d-3fe903d1f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3dd816-23cf-4899-9a68-de877f4e3199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3dd816-23cf-4899-9a68-de877f4e3199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'affa6a7e-7493-4f02-a0b9-ececfd19f8e1', 'volume_name': 'volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dd496a-ff46-44f9-b1da-7269ec699f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dd496a-ff46-44f9-b1da-7269ec699f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85df45f6-f849-469a-a0b3-94242f410599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:32 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Volume affa6a7e-7493-4f02-a0b9-ececfd19f8e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1', 'volume_size': 1} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830362213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affa6a7e-7493-4f02-a0b9-ececfd19f8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744de75e829f4fd48c33fa2ba5a061e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:32Z,use_quota=True,user_id='5a364047a4ab4d1b95c433aa24215fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Creating volume affa6a7e-7493-4f02-a0b9-ececfd19f8e1 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:32 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:32 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 1073741824 Nov 02 10:21:32 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:33 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 1073741824" returned: 0 in 0.642s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:33 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 Nov 02 10:21:33 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a25480f4-2088-4068-ad38-133dbcfa966d tempest-ProjectAdminTests-451349 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8139152526855, 'free_capacity_gb': 1773.8139152526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86840) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:21:33 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1" returned: 0 in 0.408s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85df45f6-f849-469a-a0b3-94242f410599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00f7faf-f17e-483b-91f7-bba159ba45e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:33 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Volume volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 (affa6a7e-7493-4f02-a0b9-ececfd19f8e1): created successfully Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00f7faf-f17e-483b-91f7-bba159ba45e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:33 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Flow 'volume_create_manager' (4b5063ba-ce01-422f-acbe-2de413bed48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-265adcf0-1017-4af6-ac83-e329f65d1e07 tempest-ProjectReaderTests-801863055 None] Created volume successfully. Nov 02 10:21:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Acquiring lock "cinder-affa6a7e-7493-4f02-a0b9-ececfd19f8e1-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Lock "cinder-affa6a7e-7493-4f02-a0b9-ececfd19f8e1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Acquiring lock "cinder-quobyte-affa6a7e-7493-4f02-a0b9-ececfd19f8e1" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Lock "cinder-quobyte-affa6a7e-7493-4f02-a0b9-ececfd19f8e1" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:34 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5561da1-1a1d-4153-b6ef-9eef6cf4f2b2]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:35 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 Nov 02 10:21:35 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:35 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1" returned: 0 in 0.660s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:35 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1 Nov 02 10:21:35 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:35 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-affa6a7e-7493-4f02-a0b9-ececfd19f8e1" returned: 0 in 0.399s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Lock "cinder-quobyte-affa6a7e-7493-4f02-a0b9-ececfd19f8e1" released by "delete_volume" :: held 1.149s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:35 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Created reservations ['7134651a-48d0-4d57-8053-d9b72a98c0b9', 'dfd6bb46-c098-4fda-a1c1-5a9b96bfd0c6', 'e9987d34-fca8-45b9-92c6-6eb7de613963', 'c5a2e2ac-995c-4f9a-b099-1bf615fd12b1'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:36 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:36 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:36 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:36 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.347s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:36 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:36 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Deleted volume successfully. Nov 02 10:21:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b7620037-c6a8-4bd5-8b70-80afdc326d91 tempest-ProjectReaderTests-801863055 None] Lock "cinder-affa6a7e-7493-4f02-a0b9-ececfd19f8e1-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Flow 'volume_create_manager' (b408eb75-9f23-481b-9c4f-8fbf52bcb569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efb6698-04d0-4bf6-ba9f-b12c595bf48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efb6698-04d0-4bf6-ba9f-b12c595bf48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502102122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b5146a-3775-4532-bcc5-76a3b83c41aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744de75e829f4fd48c33fa2ba5a061e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:38Z,use_quota=True,user_id='5a364047a4ab4d1b95c433aa24215fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0ab5b2-f834-47b4-98f7-5f4bba59aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0ab5b2-f834-47b4-98f7-5f4bba59aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30548fc-37e5-49ec-9c8c-a507715f37fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30548fc-37e5-49ec-9c8c-a507715f37fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b5146a-3775-4532-bcc5-76a3b83c41aa', 'volume_name': 'volume-51b5146a-3775-4532-bcc5-76a3b83c41aa', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802fc8bc-758c-438e-9c48-40fe8b49207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (802fc8bc-758c-438e-9c48-40fe8b49207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2edb36-5fb4-4962-adcc-1a430d51b502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:37 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Volume 51b5146a-3775-4532-bcc5-76a3b83c41aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b5146a-3775-4532-bcc5-76a3b83c41aa', 'volume_size': 1} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502102122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b5146a-3775-4532-bcc5-76a3b83c41aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744de75e829f4fd48c33fa2ba5a061e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:38Z,use_quota=True,user_id='5a364047a4ab4d1b95c433aa24215fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Creating volume 51b5146a-3775-4532-bcc5-76a3b83c41aa {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:37 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:37 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa 1073741824 Nov 02 10:21:37 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:38 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa 1073741824" returned: 0 in 0.586s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:38 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa Nov 02 10:21:38 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:39 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa" returned: 0 in 0.436s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2edb36-5fb4-4962-adcc-1a430d51b502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b5146a-3775-4532-bcc5-76a3b83c41aa', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa764f8-a41b-4acb-a230-42700b7ce688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:39 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Volume volume-51b5146a-3775-4532-bcc5-76a3b83c41aa (51b5146a-3775-4532-bcc5-76a3b83c41aa): created successfully Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa764f8-a41b-4acb-a230-42700b7ce688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Flow 'volume_create_manager' (b408eb75-9f23-481b-9c4f-8fbf52bcb569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f15dcc93-8784-4f0e-a771-a9db54d52669 tempest-ProjectReaderTests-801863055 None] Created volume successfully. Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Flow 'volume_create_manager' (f875d282-a8c1-478e-afb6-a9b029ae0068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e73bc52-4d9a-4626-8a1b-feacce630481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e73bc52-4d9a-4626-8a1b-feacce630481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-747516585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e82bfc-439f-451c-b18b-1b1d3a623b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d86ce597c46493db868b134921fdab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:40Z,use_quota=True,user_id='649d1c46a9324e1b82baac33eb8f79fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e20e28-bd1a-444d-aa96-9349b4280de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e20e28-bd1a-444d-aa96-9349b4280de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25df6f02-da29-4161-a358-b253d6652aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25df6f02-da29-4161-a358-b253d6652aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e82bfc-439f-451c-b18b-1b1d3a623b7d', 'volume_name': 'volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0c082b-31ae-46e9-8eb6-a46c9f9b0446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0c082b-31ae-46e9-8eb6-a46c9f9b0446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed79e1e1-0ede-4a59-a7fa-1bcafb8c22a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:39 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Volume 91e82bfc-439f-451c-b18b-1b1d3a623b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d', 'volume_size': 1} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-747516585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e82bfc-439f-451c-b18b-1b1d3a623b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d86ce597c46493db868b134921fdab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:40Z,use_quota=True,user_id='649d1c46a9324e1b82baac33eb8f79fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Creating volume 91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:39 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:39 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d 1073741824 Nov 02 10:21:39 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Acquiring lock "cinder-51b5146a-3775-4532-bcc5-76a3b83c41aa-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:39 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Lock "cinder-51b5146a-3775-4532-bcc5-76a3b83c41aa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Acquiring lock "cinder-quobyte-51b5146a-3775-4532-bcc5-76a3b83c41aa" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Lock "cinder-quobyte-51b5146a-3775-4532-bcc5-76a3b83c41aa" acquired by "delete_volume" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497387c-edc0-49d1-993b-293393daf8d7]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:40 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa Nov 02 10:21:40 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:40 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d 1073741824" returned: 0 in 0.666s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:40 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d Nov 02 10:21:40 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:40 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa" returned: 0 in 0.530s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:40 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa Nov 02 10:21:40 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:40 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d" returned: 0 in 0.329s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed79e1e1-0ede-4a59-a7fa-1bcafb8c22a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67c5211-2a62-48db-83c3-afe5a2c2ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:40 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Volume volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d (91e82bfc-439f-451c-b18b-1b1d3a623b7d): created successfully Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67c5211-2a62-48db-83c3-afe5a2c2ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Flow 'volume_create_manager' (f875d282-a8c1-478e-afb6-a9b029ae0068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:40 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b96128cc-8c30-4314-852b-0533ad2f1f4f tempest-SnapshotDependencyTests-1171092588 None] Created volume successfully. Nov 02 10:21:40 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-51b5146a-3775-4532-bcc5-76a3b83c41aa" returned: 0 in 0.353s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Lock "cinder-quobyte-51b5146a-3775-4532-bcc5-76a3b83c41aa" released by "delete_volume" :: held 0.944s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Created reservations ['e27a3828-ac44-4c87-988e-d833f23eb85d', '06b598bb-78b1-44ee-913f-5011ef35f1dd', 'cf8cbb3b-e088-43ae-85b6-c15d5eb5adf0', 'bb8e4d1f-b9f4-44d8-a771-e370179a4bd9'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:41 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:41 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:41 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.271s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:41 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Deleted volume successfully. Nov 02 10:21:41 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-362f505b-4001-45fc-849e-0042bb4293c4 tempest-ProjectReaderTests-801863055 None] Lock "cinder-51b5146a-3775-4532-bcc5-76a3b83c41aa-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (32c98f65-7fd6-4765-ae70-e1942dd22b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d3b83a-766e-47c1-b6fb-f54d35a27079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d3b83a-766e-47c1-b6fb-f54d35a27079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568522242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cce1636-3dce-4c6f-aa82-5e7a0665fc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:42Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c48e7e-b797-479d-8b16-c0dc9bdf1716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c48e7e-b797-479d-8b16-c0dc9bdf1716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a124b6d-467b-476d-a37a-556d3300273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a124b6d-467b-476d-a37a-556d3300273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cce1636-3dce-4c6f-aa82-5e7a0665fc19', 'volume_name': 'volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cdb5d7-b348-4629-8979-8df95390e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cdb5d7-b348-4629-8979-8df95390e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf0095b-290f-4854-b0c8-71b1dd1578f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Volume 9cce1636-3dce-4c6f-aa82-5e7a0665fc19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19', 'volume_size': 1} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568522242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cce1636-3dce-4c6f-aa82-5e7a0665fc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:42Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Creating volume 9cce1636-3dce-4c6f-aa82-5e7a0665fc19 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:42 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:42 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 1073741824 Nov 02 10:21:42 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Flow 'volume_create_manager' (1b82e727-f3f0-4a3a-928e-c049b5f77164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423546fe-23ef-459f-9541-f750bd40cf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 1073741824" returned: 0 in 0.620s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423546fe-23ef-459f-9541-f750bd40cf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778537317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0834e7d7-825c-4482-914e-356f4e150e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744de75e829f4fd48c33fa2ba5a061e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:43Z,use_quota=True,user_id='5a364047a4ab4d1b95c433aa24215fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3c86ce-8a05-4a74-be15-07bd498555c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3c86ce-8a05-4a74-be15-07bd498555c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36895c28-d773-4d6a-a0df-1ba428a2dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36895c28-d773-4d6a-a0df-1ba428a2dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0834e7d7-825c-4482-914e-356f4e150e26', 'volume_name': 'volume-0834e7d7-825c-4482-914e-356f4e150e26', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0da409-ba00-4d19-97d0-ebdeb4fe5330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0da409-ba00-4d19-97d0-ebdeb4fe5330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a1e19e-f8c9-4caa-8980-cddea048df6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:42 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Volume 0834e7d7-825c-4482-914e-356f4e150e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0834e7d7-825c-4482-914e-356f4e150e26', 'volume_size': 1} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:42 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 Nov 02 10:21:42 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:43 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" returned: 0 in 0.279s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.982s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf0095b-290f-4854-b0c8-71b1dd1578f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cb65cb-30cb-4d8f-a8eb-82e8fd4f9d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Creating offline snapshot 344886b2-656f-4cf6-b182-72e10decf729 of volume 91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:43 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Volume volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 (9cce1636-3dce-4c6f-aa82-5e7a0665fc19): created successfully Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cb65cb-30cb-4d8f-a8eb-82e8fd4f9d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (32c98f65-7fd6-4765-ae70-e1942dd22b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f2bac3-5339-4367-b09f-12ec7ea135b0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:43 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-083cda3d-d800-44e5-80a8-9287bc9762bb tempest-ProjectReaderTests-888253292 None] Created volume successfully. Nov 02 10:21:43 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d Nov 02 10:21:43 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:43 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d" returned: 0 in 0.408s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:43 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 1G Nov 02 10:21:43 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:44 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 1G" returned: 0 in 0.490s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:44 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 Nov 02 10:21:44 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:44 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729" returned: 0 in 0.312s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:44 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 is being set with open permissions: ugo+rw Nov 02 10:21:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:44 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 Nov 02 10:21:44 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:44 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729" returned: 0 in 0.261s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:44 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.info Nov 02 10:21:44 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:45 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.info" returned: 0 in 0.281s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:45 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.info is being set with open permissions: ugo+rw Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:45 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.info Nov 02 10:21:45 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (ac615e24-c046-4e5c-b816-a18324052369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c164ec52-0a54-4d7c-bf3c-5caabb102da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c164ec52-0a54-4d7c-bf3c-5caabb102da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186388222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d246ff85-5e7a-4e2e-9530-27b1ba08a3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:45Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5698dc2f-f4f3-42cd-ba10-e5de2889f7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5698dc2f-f4f3-42cd-ba10-e5de2889f7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a71835-7e94-4661-9bdf-9c54c25ca40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a71835-7e94-4661-9bdf-9c54c25ca40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd246ff85-5e7a-4e2e-9530-27b1ba08a3b9', 'volume_name': 'volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe658395-251f-42fc-9269-44690b7ff77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe658395-251f-42fc-9269-44690b7ff77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6411015d-df17-4dfb-878d-6f9b4f88eb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:45 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Volume d246ff85-5e7a-4e2e-9530-27b1ba08a3b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9', 'volume_size': 1} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:45 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.info" returned: 0 in 0.271s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.468s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778537317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0834e7d7-825c-4482-914e-356f4e150e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744de75e829f4fd48c33fa2ba5a061e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:43Z,use_quota=True,user_id='5a364047a4ab4d1b95c433aa24215fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Creating volume 0834e7d7-825c-4482-914e-356f4e150e26 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:45 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:45 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26 1073741824 Nov 02 10:21:45 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7b75fda0-84c7-44f5-b2ce-b185a1c62f3a tempest-SnapshotDependencyTests-1171092588 None] Create snapshot completed successfully Nov 02 10:21:45 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26 1073741824" returned: 0 in 0.434s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:45 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26 Nov 02 10:21:45 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:46 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26" returned: 0 in 0.251s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.798s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a1e19e-f8c9-4caa-8980-cddea048df6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0834e7d7-825c-4482-914e-356f4e150e26', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e6be10-5835-47c4-a176-0d0a7c60a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Creating offline snapshot 35d0b9de-f4ea-4933-b10f-fd27024a4256 of volume 9cce1636-3dce-4c6f-aa82-5e7a0665fc19 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:46 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Volume volume-0834e7d7-825c-4482-914e-356f4e150e26 (0834e7d7-825c-4482-914e-356f4e150e26): created successfully Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e6be10-5835-47c4-a176-0d0a7c60a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Flow 'volume_create_manager' (1b82e727-f3f0-4a3a-928e-c049b5f77164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e7dfbe-4c1c-4669-9fe7-c17e605e00e3]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:46 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-68051d30-f8e8-476d-ad3d-8c419d0792a1 tempest-ProjectReaderTests-801863055 None] Created volume successfully. Nov 02 10:21:46 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 Nov 02 10:21:46 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:46 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" returned: 0 in 0.404s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:46 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 1G Nov 02 10:21:46 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Flow 'volume_create_manager' (13db630a-1127-411a-a0f4-2bf398f80f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1895aa88-07f9-4a75-b85c-fa785ecae9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Acquiring lock "cinder-0834e7d7-825c-4482-914e-356f4e150e26-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1895aa88-07f9-4a75-b85c-fa785ecae9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87dbc44f-304d-406d-b780-d1ae383cca01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d86ce597c46493db868b134921fdab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=344886b2-656f-4cf6-b182-72e10decf729,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:47Z,use_quota=True,user_id='649d1c46a9324e1b82baac33eb8f79fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41378269-4531-42ec-80bc-3118b0e74145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41378269-4531-42ec-80bc-3118b0e74145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b89a6d3-845f-4262-94a5-a2e749b2c5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b89a6d3-845f-4262-94a5-a2e749b2c5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '87dbc44f-304d-406d-b780-d1ae383cca01', 'volume_name': 'volume-87dbc44f-304d-406d-b780-d1ae383cca01', 'volume_size': 1, 'snapshot_id': '344886b2-656f-4cf6-b182-72e10decf729'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29040308-6fef-4671-a657-088ee1b84b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29040308-6fef-4671-a657-088ee1b84b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eda744-03f9-4bb8-ace5-aed38900da45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Volume 87dbc44f-304d-406d-b780-d1ae383cca01: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-87dbc44f-304d-406d-b780-d1ae383cca01', 'volume_size': 1, 'snapshot_id': '344886b2-656f-4cf6-b182-72e10decf729'} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Lock "cinder-0834e7d7-825c-4482-914e-356f4e150e26-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:47 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 1G" returned: 0 in 0.486s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:47 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 Nov 02 10:21:47 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Acquiring lock "cinder-quobyte-0834e7d7-825c-4482-914e-356f4e150e26" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Lock "cinder-quobyte-0834e7d7-825c-4482-914e-356f4e150e26" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aea540a-59f9-498e-bbc2-2ea357a42c2a]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:47 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26 Nov 02 10:21:47 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:47 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256" returned: 0 in 0.284s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:47 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 is being set with open permissions: ugo+rw Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:47 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 Nov 02 10:21:47 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:47 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26" returned: 0 in 0.397s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:47 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26 Nov 02 10:21:47 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:47 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256" returned: 0 in 0.250s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:47 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.info Nov 02 10:21:47 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:47 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0834e7d7-825c-4482-914e-356f4e150e26" returned: 0 in 0.280s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Lock "cinder-quobyte-0834e7d7-825c-4482-914e-356f4e150e26" released by "delete_volume" :: held 0.723s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:47 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.info" returned: 0 in 0.258s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:47 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.info is being set with open permissions: ugo+rw Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:47 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.info Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Created reservations ['d00666d8-4982-4402-b90a-55699911c963', '60e4db61-26a4-4c32-b859-55bce565346e', '2f7e1085-02d8-4e1f-88da-a6ea3a57ebb7', '449c8329-ead0-4de5-9363-26640f260c13'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:47 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:48 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:48 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:48 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.info" returned: 0 in 0.258s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.896s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186388222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d246ff85-5e7a-4e2e-9530-27b1ba08a3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:45Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Creating volume d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:48 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:48 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 1073741824 Nov 02 10:21:48 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cdb9a130-6d14-4986-b8ed-5aa2fd0557ea tempest-ProjectReaderTests-888253292 None] Create snapshot completed successfully Nov 02 10:21:48 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.280s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Deleted volume successfully. Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-0b3cf508-070a-4b3c-911b-d58266fa9ca7 tempest-ProjectReaderTests-801863055 None] Lock "cinder-0834e7d7-825c-4482-914e-356f4e150e26-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:48 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 1073741824" returned: 0 in 0.543s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-35d0b9de-f4ea-4933-b10f-fd27024a4256-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:48 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 Nov 02 10:21:48 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Lock "cinder-35d0b9de-f4ea-4933-b10f-fd27024a4256-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-35d0b9de-f4ea-4933-b10f-fd27024a4256" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-35d0b9de-f4ea-4933-b10f-fd27024a4256" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Deleting offline snapshot 35d0b9de-f4ea-4933-b10f-fd27024a4256 of volume 9cce1636-3dce-4c6f-aa82-5e7a0665fc19 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] snapshot_file for this snap is: volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a260ef0e-63c4-4f6c-a4d1-0980d387cbb8]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:48 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:49 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 Nov 02 10:21:49 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:49 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" returned: 0 in 0.290s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "cinder-quobyte-344886b2-656f-4cf6-b182-72e10decf729-87dbc44f-304d-406d-b780-d1ae383cca01" by "_create_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6411015d-df17-4dfb-878d-6f9b4f88eb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9e5808-0a9f-46c0-8043-7ca54182cf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-344886b2-656f-4cf6-b182-72e10decf729-87dbc44f-304d-406d-b780-d1ae383cca01" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Creating volume 87dbc44f-304d-406d-b780-d1ae383cca01 from snapshot 344886b2-656f-4cf6-b182-72e10decf729 {{(pid=86840) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "cinder-quobyte-87dbc44f-304d-406d-b780-d1ae383cca01" by "_copy_volume_from_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:49 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Volume volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 (d246ff85-5e7a-4e2e-9530-27b1ba08a3b9): created successfully Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9e5808-0a9f-46c0-8043-7ca54182cf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (ac615e24-c046-4e5c-b816-a18324052369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-87dbc44f-304d-406d-b780-d1ae383cca01" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] snapshot: 344886b2-656f-4cf6-b182-72e10decf729, volume: 87dbc44f-304d-406d-b780-d1ae383cca01, {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:21:49 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ac2b28a5-7d75-4ce3-8b41-765025ac076a tempest-ProjectMemberTests-612922493 None] Created volume successfully. Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ff63f8-60b5-4859-8bbd-ec2bfff4e892]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:49 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256" returned: 0 in 0.396s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f636c3-6fbb-4d97-b55d-a86e67586e74]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:49 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 Nov 02 10:21:49 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:49 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 Nov 02 10:21:49 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:49 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729" returned: 0 in 0.439s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bed44d-48e6-4788-a2fe-57e6a762373b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:49 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d Nov 02 10:21:49 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:49 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" returned: 0 in 0.514s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:49 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 Nov 02 10:21:49 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:50 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d" returned: 0 in 0.553s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Creating direct copy from snapshot {{(pid=86840) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG cinder.utils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Path /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 not found in is_blk_device check {{(pid=86840) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:50 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 Nov 02 10:21:50 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:50 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256" returned: 0 in 0.483s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:50 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256 Nov 02 10:21:50 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:50 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19.35d0b9de-f4ea-4933-b10f-fd27024a4256" returned: 0 in 0.351s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-35d0b9de-f4ea-4933-b10f-fd27024a4256" released by "_delete_snapshot" :: held 1.920s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" released by "delete_snapshot" :: held 1.949s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:50 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Created reservations ['07c0da68-4678-4b10-bfa0-f2f00591a6d9', '5af9a19d-2a03-4904-ad02-9ba3219dd71c', '34868179-77d0-4805-9307-8fe12a8ab951', '29940248-797c-411a-8451-9c17163aecf8'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:51 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Delete snapshot completed successfully. Nov 02 10:21:51 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-c72cdb6d-e7c9-46b4-bb12-d6c0db9adf63 tempest-ProjectReaderTests-888253292 None] Lock "cinder-35d0b9de-f4ea-4933-b10f-fd27024a4256-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-9cce1636-3dce-4c6f-aa82-5e7a0665fc19-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Lock "cinder-9cce1636-3dce-4c6f-aa82-5e7a0665fc19-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" acquired by "delete_volume" :: waited 0.028s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:52 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10a525e-4874-44a1-b06d-484642e504c9]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:52 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 Nov 02 10:21:52 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:52 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" returned: 0 in 0.570s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:52 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19 Nov 02 10:21:52 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:53 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" returned: 0 in 0.374s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-9cce1636-3dce-4c6f-aa82-5e7a0665fc19" released by "delete_volume" :: held 1.079s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Created reservations ['9250ac8a-e756-4134-9836-1d613afdfb2e', '336789f8-c66b-4eb1-9792-1af8911e6467', 'b396fbc9-fe38-4cdc-978d-ea66291dc0c4', '1140ead6-0e8e-4902-b77e-f43245d518ab'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:53 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:21:53 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:53 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.344s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:21:53 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Deleted volume successfully. Nov 02 10:21:53 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8798cb0d-10a4-4a7b-91c2-5fa8ad72407a tempest-ProjectReaderTests-888253292 None] Lock "cinder-9cce1636-3dce-4c6f-aa82-5e7a0665fc19-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (0ea6f272-f652-43d5-8158-0d67109e2e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367293e4-1e9f-4689-adff-581123221a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367293e4-1e9f-4689-adff-581123221a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296422968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d82586-8c46-4e52-b2ab-efb5259ea6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:55Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8670dfd0-026b-40f7-aeee-30a276d7083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8670dfd0-026b-40f7-aeee-30a276d7083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd500e92-7be7-4371-95ae-f906ee7fc7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd500e92-7be7-4371-95ae-f906ee7fc7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d82586-8c46-4e52-b2ab-efb5259ea6bb', 'volume_name': 'volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee9ee5b-f7cb-436f-b24b-0e6b70be4cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee9ee5b-f7cb-436f-b24b-0e6b70be4cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae214b2-7748-4553-83d9-d5b5b9f1667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:55 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Volume d2d82586-8c46-4e52-b2ab-efb5259ea6bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb', 'volume_size': 1} Nov 02 10:21:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:56 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01" returned: 0 in 6.557s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:56 devstack cinder-volume[86840]: DEBUG cinder.image.image_utils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Image conversion details: src /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 {{(pid=86840) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 10:21:56 devstack cinder-volume[86840]: INFO cinder.image.image_utils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Converted 1024.00 MB image at 156.14 MB/s Nov 02 10:21:56 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 is being set with open permissions: ugo+rw Nov 02 10:21:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:56 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 Nov 02 10:21:56 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:57 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01" returned: 0 in 0.251s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-87dbc44f-304d-406d-b780-d1ae383cca01" released by "_copy_volume_from_snapshot" :: held 7.903s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-344886b2-656f-4cf6-b182-72e10decf729-87dbc44f-304d-406d-b780-d1ae383cca01" released by "_create_volume_from_snapshot" :: held 8.005s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.044s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.025s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Creating offline snapshot 18a99b72-b41e-4aeb-8847-6772347901fc of volume d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7eda744-03f9-4bb8-ace5-aed38900da45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87dbc44f-304d-406d-b780-d1ae383cca01', 'volume_size': 1, 'snapshot_id': '344886b2-656f-4cf6-b182-72e10decf729'}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf0a238-3993-4fe8-a794-de998f6d6e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a602ccfc-2617-44a4-8a22-3e17bfb14a43]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:57 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Volume volume-87dbc44f-304d-406d-b780-d1ae383cca01 (87dbc44f-304d-406d-b780-d1ae383cca01): created successfully Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf0a238-3993-4fe8-a794-de998f6d6e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Flow 'volume_create_manager' (13db630a-1127-411a-a0f4-2bf398f80f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:21:57 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5684433d-ac84-4cda-a902-605e7d436708 tempest-SnapshotDependencyTests-1171092588 None] Created volume successfully. Nov 02 10:21:57 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 Nov 02 10:21:57 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:57 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" returned: 0 in 0.377s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:57 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc 1G Nov 02 10:21:57 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "cinder-344886b2-656f-4cf6-b182-72e10decf729-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-344886b2-656f-4cf6-b182-72e10decf729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "cinder-quobyte-91e82bfc-439f-451c-b18b-1b1d3a623b7d" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-91e82bfc-439f-451c-b18b-1b1d3a623b7d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "cinder-quobyte-344886b2-656f-4cf6-b182-72e10decf729" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-344886b2-656f-4cf6-b182-72e10decf729" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Deleting offline snapshot 344886b2-656f-4cf6-b182-72e10decf729 of volume 91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] snapshot_file for this snap is: volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf64ba1-d5bf-44cf-aa57-b0396bcaafda]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc 1G" returned: 0 in 0.459s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc Nov 02 10:21:58 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 Nov 02 10:21:58 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc" returned: 0 in 0.301s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:58 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc is being set with open permissions: ugo+rw Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc Nov 02 10:21:58 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729" returned: 0 in 0.394s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d1b5ec-65d6-4a49-9e15-90e178d51298]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d Nov 02 10:21:58 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc" returned: 0 in 0.254s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.info Nov 02 10:21:58 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:58 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.info" returned: 0 in 0.294s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:58 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.info is being set with open permissions: ugo+rw Nov 02 10:21:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:58 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.info Nov 02 10:21:58 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:59 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d" returned: 0 in 0.603s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:59 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 Nov 02 10:21:59 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:59 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.info" returned: 0 in 0.247s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.707s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296422968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d82586-8c46-4e52-b2ab-efb5259ea6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:55Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Creating volume d2d82586-8c46-4e52-b2ab-efb5259ea6bb {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:21:59 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:59 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb 1073741824 Nov 02 10:21:59 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8d956910-0d49-4dba-b917-1fdab07e2fa2 tempest-ProjectMemberTests-612922493 None] Create snapshot completed successfully Nov 02 10:21:59 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729" returned: 0 in 0.321s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:59 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729 Nov 02 10:21:59 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:59 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d.344886b2-656f-4cf6-b182-72e10decf729" returned: 0 in 0.273s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-18a99b72-b41e-4aeb-8847-6772347901fc-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-18a99b72-b41e-4aeb-8847-6772347901fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-344886b2-656f-4cf6-b182-72e10decf729" released by "_delete_snapshot" :: held 1.748s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-18a99b72-b41e-4aeb-8847-6772347901fc" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-91e82bfc-439f-451c-b18b-1b1d3a623b7d" released by "delete_snapshot" :: held 1.785s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:21:59 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-18a99b72-b41e-4aeb-8847-6772347901fc" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Deleting offline snapshot 18a99b72-b41e-4aeb-8847-6772347901fc of volume d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] snapshot_file for this snap is: volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb 1073741824" returned: 0 in 0.601s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c76a43-8938-4762-8eac-79afef34354b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:21:59 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb Nov 02 10:21:59 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:59 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Created reservations ['cdded8da-00a3-4268-bfda-b2f7e3018355', '56c85124-1e0f-46c8-bf41-eaf9333e6f14', 'ee07ab3e-16a7-4d85-9e1c-af5488492878', '44201b81-4c67-41e0-ab06-4e9b055c8d7e'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:21:59 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc Nov 02 10:21:59 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:21:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Delete snapshot completed successfully. Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-39aad338-f05f-4460-b4ea-cdc6f2c5f258 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-344886b2-656f-4cf6-b182-72e10decf729-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "cinder-91e82bfc-439f-451c-b18b-1b1d3a623b7d-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-91e82bfc-439f-451c-b18b-1b1d3a623b7d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "cinder-quobyte-91e82bfc-439f-451c-b18b-1b1d3a623b7d" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-91e82bfc-439f-451c-b18b-1b1d3a623b7d" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:00 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8582ae-39aa-44b1-8df4-630c900bcc2f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" returned: 0 in 0.356s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae214b2-7748-4553-83d9-d5b5b9f1667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f9e00d-3bde-4eea-9617-a60b415951a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:00 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Volume volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb (d2d82586-8c46-4e52-b2ab-efb5259ea6bb): created successfully Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f9e00d-3bde-4eea-9617-a60b415951a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (0ea6f272-f652-43d5-8158-0d67109e2e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:00 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:00 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-86d501a0-174d-4141-85e6-677a9515216b tempest-ProjectReaderTests-888253292 None] Created volume successfully. Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc" returned: 0 in 0.472s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746eef3-ddbe-40ed-95ce-d7b7a0258404]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:00 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d Nov 02 10:22:00 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:00 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 Nov 02 10:22:00 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:00 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d" returned: 0 in 0.403s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:00 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d Nov 02 10:22:00 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:00 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" returned: 0 in 0.465s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:00 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc Nov 02 10:22:00 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Creating offline snapshot a887db58-883c-42b8-aa82-9224c4d0da4d of volume d2d82586-8c46-4e52-b2ab-efb5259ea6bb {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4666878-9970-47d0-9712-4df4f38a7026]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:00 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-91e82bfc-439f-451c-b18b-1b1d3a623b7d" returned: 0 in 0.307s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-91e82bfc-439f-451c-b18b-1b1d3a623b7d" released by "delete_volume" :: held 0.778s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:00 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb Nov 02 10:22:00 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:00 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Created reservations ['414c073e-b437-46a9-bc25-793f04530451', 'fc7c161e-4479-461d-a1cf-044cc484eab0', 'd311ae38-474d-4670-ae80-24617d8d2c5d', '9a264664-d61f-4b22-b9fe-df0a4767c5eb'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:01 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:01 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:01 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc" returned: 0 in 0.387s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:01 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc Nov 02 10:22:01 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:01 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" returned: 0 in 0.432s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "cinder-87dbc44f-304d-406d-b780-d1ae383cca01-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-87dbc44f-304d-406d-b780-d1ae383cca01-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:01 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d 1G Nov 02 10:22:01 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "cinder-quobyte-87dbc44f-304d-406d-b780-d1ae383cca01" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-87dbc44f-304d-406d-b780-d1ae383cca01" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:01 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.340s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:01 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Deleted volume successfully. Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09d93e1-e266-4e65-8b3d-4d3e66a7a277]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:01 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9.18a99b72-b41e-4aeb-8847-6772347901fc" returned: 0 in 0.289s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-ec5a1d56-3ee7-4fe8-8d0f-dd20894d56eb tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-91e82bfc-439f-451c-b18b-1b1d3a623b7d-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-18a99b72-b41e-4aeb-8847-6772347901fc" released by "_delete_snapshot" :: held 1.758s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" released by "delete_snapshot" :: held 1.803s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:01 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 Nov 02 10:22:01 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Created reservations ['e4d18c7e-66b1-4092-bd9b-aa991cd9e4a6', '775b2332-1b1d-494a-8d8b-f956d87d0611', '2e180ba8-8fb5-4b5c-8982-aed74355f8f2', '3c5f2fd3-5ff7-4837-a0b8-c04b51726143'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:01 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Delete snapshot completed successfully. Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-b1ec8e82-ba21-411d-a1fb-f6b8665914a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-18a99b72-b41e-4aeb-8847-6772347901fc-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:01 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d 1G" returned: 0 in 0.519s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:01 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d Nov 02 10:22:01 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:01 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01" returned: 0 in 0.442s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:01 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01 Nov 02 10:22:01 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f633834f-bf74-4478-92de-b002dedb919b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:02 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 Nov 02 10:22:02 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:02 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d" returned: 0 in 0.326s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:02 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d is being set with open permissions: ugo+rw Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:02 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d Nov 02 10:22:02 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:02 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-87dbc44f-304d-406d-b780-d1ae383cca01" returned: 0 in 0.285s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-quobyte-87dbc44f-304d-406d-b780-d1ae383cca01" released by "delete_volume" :: held 0.799s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Created reservations ['1c0964ea-4252-4954-a83a-c7d71aa3e455', '9b658d4b-61c4-4124-a4cf-82dee531278e', '9f1aabfa-05e5-466d-b2b6-2175fc7179b3', '23b2ce65-ff3e-4030-bd83-7045241898c4'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:02 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:02 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:02 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" returned: 0 in 0.400s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:02 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d" returned: 0 in 0.285s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:02 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9 Nov 02 10:22:02 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:02 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.info Nov 02 10:22:02 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:02 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.290s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Deleted volume successfully. Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-d05bd69a-63d5-4f04-a679-d35ed6897a65 tempest-SnapshotDependencyTests-1171092588 None] Lock "cinder-87dbc44f-304d-406d-b780-d1ae383cca01-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:02 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" returned: 0 in 0.327s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9" released by "delete_volume" :: held 0.805s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Created reservations ['b09aa93c-d71a-4ee1-b6e2-197c902cb766', 'e57f9a00-9a2b-4a03-b0e3-1fbaf6012373', '41511ea1-8c31-4838-9c0a-71b4b23507d8', '30e24a6a-a0b2-480c-9fb1-a24138926138'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:02 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.info" returned: 0 in 0.348s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:02 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.info is being set with open permissions: ugo+rw Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:02 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.info Nov 02 10:22:02 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:02 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:02 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:03 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.info" returned: 0 in 0.321s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-c13b5af3-2f65-4baf-87b9-dbcba1192169 tempest-ProjectReaderTests-888253292 None] Create snapshot completed successfully Nov 02 10:22:03 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.343s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:03 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Deleted volume successfully. Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a85e452d-75e5-4442-9dba-87631aab3fe9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-d246ff85-5e7a-4e2e-9530-27b1ba08a3b9-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (bd327175-6f88-4a33-abab-79d100cd665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12206ae-59e7-4e62-9dbc-42ee508223aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12206ae-59e7-4e62-9dbc-42ee508223aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671310701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18700f58-8360-427d-8ada-bba594442e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:04Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d79500-fcc6-42db-be04-286133bb664e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d79500-fcc6-42db-be04-286133bb664e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821c48f9-020a-48af-baed-ee5738748f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821c48f9-020a-48af-baed-ee5738748f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18700f58-8360-427d-8ada-bba594442e1c', 'volume_name': 'volume-18700f58-8360-427d-8ada-bba594442e1c', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae3b742-6494-40d6-b81f-4cf8f6c0c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae3b742-6494-40d6-b81f-4cf8f6c0c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a84e76-2903-4bb5-9ec0-700d40ff9c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:03 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Volume 18700f58-8360-427d-8ada-bba594442e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18700f58-8360-427d-8ada-bba594442e1c', 'volume_size': 1} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671310701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18700f58-8360-427d-8ada-bba594442e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:04Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Creating volume 18700f58-8360-427d-8ada-bba594442e1c {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:03 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:03 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c 1073741824 Nov 02 10:22:03 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-a887db58-883c-42b8-aa82-9224c4d0da4d-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Lock "cinder-a887db58-883c-42b8-aa82-9224c4d0da4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:03 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-a887db58-883c-42b8-aa82-9224c4d0da4d" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-a887db58-883c-42b8-aa82-9224c4d0da4d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Deleting offline snapshot a887db58-883c-42b8-aa82-9224c4d0da4d of volume d2d82586-8c46-4e52-b2ab-efb5259ea6bb {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] snapshot_file for this snap is: volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea7d1f6-1a2e-4bab-ac0e-a5e5d2e359ba]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:04 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d Nov 02 10:22:04 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:04 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c 1073741824" returned: 0 in 0.532s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:04 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c Nov 02 10:22:04 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:04 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d" returned: 0 in 0.430s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:04 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c" returned: 0 in 0.293s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f198800-e132-4f1e-be59-16fbcaab8971]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a84e76-2903-4bb5-9ec0-700d40ff9c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18700f58-8360-427d-8ada-bba594442e1c', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8cc795-55d0-49b3-9c92-87588012c5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:04 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Volume volume-18700f58-8360-427d-8ada-bba594442e1c (18700f58-8360-427d-8ada-bba594442e1c): created successfully Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8cc795-55d0-49b3-9c92-87588012c5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (bd327175-6f88-4a33-abab-79d100cd665b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-9cbaa6c6-1494-46fc-b437-7364fec4fe15 tempest-ProjectMemberTests-612922493 None] Created volume successfully. Nov 02 10:22:04 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb Nov 02 10:22:04 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:04 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" returned: 0 in 0.392s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:04 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d Nov 02 10:22:04 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:05 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d" returned: 0 in 0.392s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:05 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d Nov 02 10:22:05 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:05 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb.a887db58-883c-42b8-aa82-9224c4d0da4d" returned: 0 in 0.267s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-a887db58-883c-42b8-aa82-9224c4d0da4d" released by "_delete_snapshot" :: held 1.619s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" released by "delete_snapshot" :: held 1.644s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Created reservations ['7436e750-911e-4a34-b516-da102dba3aa9', '50708d95-0e5d-463c-b71d-e1bbbe31a5ee', '8b5c2990-1aab-439f-955e-670ce03a8f12', '5e1b0854-e6b2-45a6-bf5a-03e3ed1068aa'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:05 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Delete snapshot completed successfully. Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-64b6e123-fbc7-4e91-bd31-8f453270fd6b tempest-ProjectReaderTests-888253292 None] Lock "cinder-a887db58-883c-42b8-aa82-9224c4d0da4d-delete_snapshot" released by "delete_snapshot" :: held 1.826s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Creating offline snapshot 73b2f267-1fdb-4332-882b-b484c4bbf093 of volume 18700f58-8360-427d-8ada-bba594442e1c {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0636d174-07c6-4963-9ea3-399d4781fb13]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:05 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c Nov 02 10:22:05 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-d2d82586-8c46-4e52-b2ab-efb5259ea6bb-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Lock "cinder-d2d82586-8c46-4e52-b2ab-efb5259ea6bb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45de23d-0707-41ef-a772-e5170c007034]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:06 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c" returned: 0 in 0.413s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:06 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 1G Nov 02 10:22:06 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:06 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb Nov 02 10:22:06 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:06 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" returned: 0 in 0.514s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:06 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb Nov 02 10:22:06 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:06 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 1G" returned: 0 in 0.568s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18700f58-8360-427d-8ada-bba594442e1c -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:06 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18700f58-8360-427d-8ada-bba594442e1c -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 Nov 02 10:22:06 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:07 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" returned: 0 in 0.256s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-d2d82586-8c46-4e52-b2ab-efb5259ea6bb" released by "delete_volume" :: held 0.849s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Created reservations ['20d64210-f7ba-4e48-861a-46a7447104c2', '575e2ce5-7c26-4db5-832d-0a582dbe24cc', '0dd6565f-6892-4f52-a21d-014aabdcc959', '8552c076-2151-42ab-81b7-ca25419125dd'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:07 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18700f58-8360-427d-8ada-bba594442e1c -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093" returned: 0 in 0.328s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:07 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 is being set with open permissions: ugo+rw Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:07 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 Nov 02 10:22:07 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:07 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:07 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:07 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093" returned: 0 in 0.326s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:07 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.info Nov 02 10:22:07 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:07 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.375s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:07 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Deleted volume successfully. Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7ba9bf2f-1697-45d1-b171-65401cfbe75d tempest-ProjectReaderTests-888253292 None] Lock "cinder-d2d82586-8c46-4e52-b2ab-efb5259ea6bb-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:07 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.info" returned: 0 in 0.327s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:07 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.info is being set with open permissions: ugo+rw Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:07 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.info Nov 02 10:22:07 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (9cf11b31-dfb6-4b99-bca4-f3e02c8c2942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec65bb4-9081-43ca-ae8b-a7d6e2d129db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec65bb4-9081-43ca-ae8b-a7d6e2d129db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573369993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b034672e-f8e2-4368-a2c7-68e6942c5eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:08Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d93981b-7161-4139-bec3-2f6b90e085d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:07 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d93981b-7161-4139-bec3-2f6b90e085d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a592de98-0607-4b8e-9682-9d4530b706e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a592de98-0607-4b8e-9682-9d4530b706e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b034672e-f8e2-4368-a2c7-68e6942c5eb6', 'volume_name': 'volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ded7b6-80df-44c9-9ea5-b5536c766d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ded7b6-80df-44c9-9ea5-b5536c766d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0b5b3d-cb2e-4e5f-90ab-efb00488bc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:08 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Volume b034672e-f8e2-4368-a2c7-68e6942c5eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6', 'volume_size': 1} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:08 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.info" returned: 0 in 0.274s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573369993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b034672e-f8e2-4368-a2c7-68e6942c5eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:08Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Creating volume b034672e-f8e2-4368-a2c7-68e6942c5eb6 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:08 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:08 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 1073741824 Nov 02 10:22:08 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-9662a6cb-09bc-4465-81a3-03149ba2bb23 tempest-ProjectMemberTests-612922493 None] Create snapshot completed successfully Nov 02 10:22:08 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 1073741824" returned: 0 in 0.489s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:08 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 Nov 02 10:22:08 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:08 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6" returned: 0 in 0.283s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-73b2f267-1fdb-4332-882b-b484c4bbf093-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0b5b3d-cb2e-4e5f-90ab-efb00488bc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa91c854-dcee-46ca-8b21-dfe8de07965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Lock "cinder-73b2f267-1fdb-4332-882b-b484c4bbf093-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-18700f58-8360-427d-8ada-bba594442e1c" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:09 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Volume volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 (b034672e-f8e2-4368-a2c7-68e6942c5eb6): created successfully Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa91c854-dcee-46ca-8b21-dfe8de07965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (9cf11b31-dfb6-4b99-bca4-f3e02c8c2942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-18700f58-8360-427d-8ada-bba594442e1c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-73b2f267-1fdb-4332-882b-b484c4bbf093" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:09 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-68569140-87eb-4836-a37d-a837ed8de3b8 tempest-ProjectReaderTests-888253292 None] Created volume successfully. Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-73b2f267-1fdb-4332-882b-b484c4bbf093" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Deleting offline snapshot 73b2f267-1fdb-4332-882b-b484c4bbf093 of volume 18700f58-8360-427d-8ada-bba594442e1c {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] snapshot_file for this snap is: volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e2540-7d06-4270-8468-d80c615afbbb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:09 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 Nov 02 10:22:09 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:09 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093" returned: 0 in 0.358s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18700f58-8360-427d-8ada-bba594442e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a154bb87-3016-498d-88b9-2be3438a34d5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:09 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c Nov 02 10:22:09 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:09 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c" returned: 0 in 0.408s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:09 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 Nov 02 10:22:09 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Creating offline snapshot ff70b598-d6b6-4c90-a015-96cb0250e47f of volume b034672e-f8e2-4368-a2c7-68e6942c5eb6 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c3eeb-5b2a-437e-9c72-79005ada3865]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:10 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093" returned: 0 in 0.459s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:10 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 Nov 02 10:22:10 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:10 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093 Nov 02 10:22:10 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:10 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c.73b2f267-1fdb-4332-882b-b484c4bbf093" returned: 0 in 0.240s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:10 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6" returned: 0 in 0.375s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-73b2f267-1fdb-4332-882b-b484c4bbf093" released by "_delete_snapshot" :: held 1.610s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-18700f58-8360-427d-8ada-bba594442e1c" released by "delete_snapshot" :: held 1.643s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:10 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f 1G Nov 02 10:22:10 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Created reservations ['83b5f16d-7d9d-4cc7-9da3-77080060387e', '022f2be9-1667-4c2b-80b4-7f5d9736e0cf', '594ec640-bc6d-43d4-b61a-98d10a757746', '7ea5eca5-deec-449a-be99-66154a49b3c5'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Delete snapshot completed successfully. Nov 02 10:22:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-95f20737-1f9d-44c8-b499-f60099ca3505 tempest-ProjectMemberTests-612922493 None] Lock "cinder-73b2f267-1fdb-4332-882b-b484c4bbf093-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:11 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f 1G" returned: 0 in 0.403s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:11 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f Nov 02 10:22:11 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-18700f58-8360-427d-8ada-bba594442e1c-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Lock "cinder-18700f58-8360-427d-8ada-bba594442e1c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-18700f58-8360-427d-8ada-bba594442e1c" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-18700f58-8360-427d-8ada-bba594442e1c" acquired by "delete_volume" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2fb122-7a4a-4079-9a98-4536a490a153]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:11 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f" returned: 0 in 0.444s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:11 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f is being set with open permissions: ugo+rw Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:11 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f Nov 02 10:22:11 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:11 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c Nov 02 10:22:11 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:11 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f" returned: 0 in 0.299s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:11 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.info Nov 02 10:22:11 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:11 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c" returned: 0 in 0.472s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:11 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:11 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c Nov 02 10:22:11 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:12 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.info" returned: 0 in 0.297s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:12 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.info is being set with open permissions: ugo+rw Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:12 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.info Nov 02 10:22:12 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:12 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-18700f58-8360-427d-8ada-bba594442e1c" returned: 0 in 0.297s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-18700f58-8360-427d-8ada-bba594442e1c" released by "delete_volume" :: held 0.841s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Created reservations ['12cdf957-9631-4529-9c17-5eea122a2190', '8d6768da-08a8-4136-8c34-7f553589239a', '73672e9b-2a94-4673-90fd-f6c6b59447df', '03620698-123c-4917-b7c2-6a9e11565750'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:12 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:12 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:12 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.info" returned: 0 in 0.340s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:12 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ce3f8a2d-881a-49d5-a4e1-eae301ffdc36 tempest-ProjectReaderTests-888253292 None] Create snapshot completed successfully Nov 02 10:22:12 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.332s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:12 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Deleted volume successfully. Nov 02 10:22:12 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6d4e6be-3f4d-498e-9b55-5b1d8ed8f804 tempest-ProjectMemberTests-612922493 None] Lock "cinder-18700f58-8360-427d-8ada-bba594442e1c-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (d145e0dc-01ef-4fa4-b002-151fad291c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e565ef3-d8db-4c52-aba5-4ba850fb4156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e565ef3-d8db-4c52-aba5-4ba850fb4156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075652914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a35fe64-6b2d-499d-91b4-68553645649b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:13Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d811f3-8bff-4349-8853-22f62ed68a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d811f3-8bff-4349-8853-22f62ed68a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bd7b63-ae52-417f-9eb2-ca8a6f52be15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bd7b63-ae52-417f-9eb2-ca8a6f52be15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a35fe64-6b2d-499d-91b4-68553645649b', 'volume_name': 'volume-0a35fe64-6b2d-499d-91b4-68553645649b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80180ca1-9f3e-4f08-9348-30fff74581f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80180ca1-9f3e-4f08-9348-30fff74581f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb790aec-5ff0-4394-935f-ca4a4876a340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:13 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Volume 0a35fe64-6b2d-499d-91b4-68553645649b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a35fe64-6b2d-499d-91b4-68553645649b', 'volume_size': 1} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075652914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a35fe64-6b2d-499d-91b4-68553645649b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:13Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Creating volume 0a35fe64-6b2d-499d-91b4-68553645649b {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:13 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:13 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b 1073741824 Nov 02 10:22:13 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-ff70b598-d6b6-4c90-a015-96cb0250e47f-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Lock "cinder-ff70b598-d6b6-4c90-a015-96cb0250e47f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-b034672e-f8e2-4368-a2c7-68e6942c5eb6" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-b034672e-f8e2-4368-a2c7-68e6942c5eb6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-ff70b598-d6b6-4c90-a015-96cb0250e47f" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-ff70b598-d6b6-4c90-a015-96cb0250e47f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Deleting offline snapshot ff70b598-d6b6-4c90-a015-96cb0250e47f of volume b034672e-f8e2-4368-a2c7-68e6942c5eb6 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] snapshot_file for this snap is: volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6d8c6a-6042-4d0b-b123-618c08279b65]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:13 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b 1073741824" returned: 0 in 0.543s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:13 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f Nov 02 10:22:13 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:13 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:13 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b Nov 02 10:22:13 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:14 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b" returned: 0 in 0.284s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:14 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb790aec-5ff0-4394-935f-ca4a4876a340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a35fe64-6b2d-499d-91b4-68553645649b', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb003d20-fdb9-4bb8-9fef-11b5b7eebb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f" returned: 0 in 0.446s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:14 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Volume volume-0a35fe64-6b2d-499d-91b4-68553645649b (0a35fe64-6b2d-499d-91b4-68553645649b): created successfully Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb003d20-fdb9-4bb8-9fef-11b5b7eebb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (d145e0dc-01ef-4fa4-b002-151fad291c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6b056d-1123-45cf-84b8-3b58bc27dcea]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:14 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e74b54d7-c563-4d16-b15e-add331342499 tempest-ProjectMemberTests-612922493 None] Created volume successfully. Nov 02 10:22:14 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 Nov 02 10:22:14 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:14 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6" returned: 0 in 0.429s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:14 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f Nov 02 10:22:14 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:14 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f" returned: 0 in 0.358s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:14 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:14 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f Nov 02 10:22:14 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:15 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6.ff70b598-d6b6-4c90-a015-96cb0250e47f" returned: 0 in 0.240s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-ff70b598-d6b6-4c90-a015-96cb0250e47f" released by "_delete_snapshot" :: held 1.593s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-b034672e-f8e2-4368-a2c7-68e6942c5eb6" released by "delete_snapshot" :: held 1.622s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Created reservations ['20dcd112-ae96-4c23-8f48-2ac53e8a2abd', 'bd2d5b9b-52d5-4e03-b5f9-e8fd1a25ae97', '8f7caa97-5598-4133-ac7e-62ec25b9e019', 'bdb19828-ac79-488f-b9fe-01db59dfe5d6'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:15 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Delete snapshot completed successfully. Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-86aaea2a-a9b8-4eea-ae18-78e99103e6eb tempest-ProjectReaderTests-888253292 None] Lock "cinder-ff70b598-d6b6-4c90-a015-96cb0250e47f-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Creating offline snapshot 54fcd84d-e2d3-408f-a75d-ba7e81d29bcc of volume 0a35fe64-6b2d-499d-91b4-68553645649b {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e21acb-c449-4f34-8dff-f883219cac06]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:15 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b Nov 02 10:22:15 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-b034672e-f8e2-4368-a2c7-68e6942c5eb6-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Lock "cinder-b034672e-f8e2-4368-a2c7-68e6942c5eb6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-b034672e-f8e2-4368-a2c7-68e6942c5eb6" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-b034672e-f8e2-4368-a2c7-68e6942c5eb6" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:15 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b" returned: 0 in 0.387s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c483d544-570a-40b7-920d-22aa201b167d]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:15 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:15 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc 1G Nov 02 10:22:15 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:15 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 Nov 02 10:22:15 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:16 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6" returned: 0 in 0.362s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:16 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:16 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6 Nov 02 10:22:16 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc 1G" returned: 0 in 0.400s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a35fe64-6b2d-499d-91b4-68553645649b -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:16 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a35fe64-6b2d-499d-91b4-68553645649b -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc Nov 02 10:22:16 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:16 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b034672e-f8e2-4368-a2c7-68e6942c5eb6" returned: 0 in 0.248s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-b034672e-f8e2-4368-a2c7-68e6942c5eb6" released by "delete_volume" :: held 0.677s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:16 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Created reservations ['045bf2e4-f076-48f0-9bb0-51b974dfd1a4', '9e4a8768-5371-4d70-97c6-9d05215ddf15', '15aa7e23-fc75-4671-8ff8-25e2fcb4904b', '1e20492d-0b2c-48b8-a0a9-583cbbe32aef'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a35fe64-6b2d-499d-91b4-68553645649b -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc" returned: 0 in 0.303s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:16 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc is being set with open permissions: ugo+rw Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:16 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc Nov 02 10:22:16 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:16 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:16 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:16 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc" returned: 0 in 0.245s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:16 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.info Nov 02 10:22:16 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:16 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.266s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:16 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Deleted volume successfully. Nov 02 10:22:16 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-7dbb0dc6-63eb-4c54-b030-ed79890b89ed tempest-ProjectReaderTests-888253292 None] Lock "cinder-b034672e-f8e2-4368-a2c7-68e6942c5eb6-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:17 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.info" returned: 0 in 0.266s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:17 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.info is being set with open permissions: ugo+rw Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:17 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.info Nov 02 10:22:17 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:17 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.info" returned: 0 in 0.259s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:17 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-cd049e8e-2bcf-4cf8-bc5a-187f0cf007fa tempest-ProjectMemberTests-612922493 None] Create snapshot completed successfully Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (25e44542-44a7-49a9-a155-9e4de5dbce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce75fca-c580-4983-9c8d-9f9220ab9be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce75fca-c580-4983-9c8d-9f9220ab9be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678180745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545c2cce-a242-4b0b-9df7-9622baf16532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:17Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0db19e-6139-4a18-8e71-8e366374865c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0db19e-6139-4a18-8e71-8e366374865c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad5f7d8-40d8-4366-bd74-a71daa1d94cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad5f7d8-40d8-4366-bd74-a71daa1d94cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '545c2cce-a242-4b0b-9df7-9622baf16532', 'volume_name': 'volume-545c2cce-a242-4b0b-9df7-9622baf16532', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb23419b-22e8-4fae-9bd9-cd1a0c6bc075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb23419b-22e8-4fae-9bd9-cd1a0c6bc075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36887314-2757-4672-a067-97a5cda36259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:17 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Volume 545c2cce-a242-4b0b-9df7-9622baf16532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-545c2cce-a242-4b0b-9df7-9622baf16532', 'volume_size': 1} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678180745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545c2cce-a242-4b0b-9df7-9622baf16532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:17Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Creating volume 545c2cce-a242-4b0b-9df7-9622baf16532 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:17 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-54fcd84d-e2d3-408f-a75d-ba7e81d29bcc-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:17 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 1073741824 Nov 02 10:22:17 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Lock "cinder-54fcd84d-e2d3-408f-a75d-ba7e81d29bcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-0a35fe64-6b2d-499d-91b4-68553645649b" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-0a35fe64-6b2d-499d-91b4-68553645649b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-54fcd84d-e2d3-408f-a75d-ba7e81d29bcc" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-54fcd84d-e2d3-408f-a75d-ba7e81d29bcc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Deleting offline snapshot 54fcd84d-e2d3-408f-a75d-ba7e81d29bcc of volume 0a35fe64-6b2d-499d-91b4-68553645649b {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] snapshot_file for this snap is: volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e61a50-fe78-4f55-a754-8c89155a369f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:17 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:17 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc Nov 02 10:22:17 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:18 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 1073741824" returned: 0 in 0.508s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:18 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc" returned: 0 in 0.421s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a35fe64-6b2d-499d-91b4-68553645649b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3edbea2-ad44-4cb4-9f78-aade82904ea0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:18 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 Nov 02 10:22:18 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:18 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b Nov 02 10:22:18 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:18 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532" returned: 0 in 0.257s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36887314-2757-4672-a067-97a5cda36259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545c2cce-a242-4b0b-9df7-9622baf16532', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb708cd-05f0-4d3b-b6dd-503285b8f0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:18 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Volume volume-545c2cce-a242-4b0b-9df7-9622baf16532 (545c2cce-a242-4b0b-9df7-9622baf16532): created successfully Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb708cd-05f0-4d3b-b6dd-503285b8f0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (25e44542-44a7-49a9-a155-9e4de5dbce2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:18 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5c887669-c0a0-4074-9ca0-2b4a9b7fe5fc tempest-ProjectReaderTests-888253292 None] Created volume successfully. Nov 02 10:22:18 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b" returned: 0 in 0.368s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:18 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc Nov 02 10:22:18 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:18 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc" returned: 0 in 0.341s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:18 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:18 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc Nov 02 10:22:18 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:19 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b.54fcd84d-e2d3-408f-a75d-ba7e81d29bcc" returned: 0 in 0.251s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-54fcd84d-e2d3-408f-a75d-ba7e81d29bcc" released by "_delete_snapshot" :: held 1.479s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-0a35fe64-6b2d-499d-91b4-68553645649b" released by "delete_snapshot" :: held 1.500s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Created reservations ['6ce8efb6-0078-475a-9e54-eb6cff7dae27', 'fb71a111-5a08-44b3-a38a-21fa2953d85c', '8eca4a5e-0a1a-4cb8-8f07-e044cc5fde95', '7519cf41-19c3-432c-a797-255cc2687684'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:19 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Delete snapshot completed successfully. Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a4492710-202f-4ec6-9bca-4e7c09f7399c tempest-ProjectMemberTests-612922493 None] Lock "cinder-54fcd84d-e2d3-408f-a75d-ba7e81d29bcc-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Creating offline snapshot 47d274cb-ee83-40ab-be79-80109853f2e7 of volume 545c2cce-a242-4b0b-9df7-9622baf16532 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-0a35fe64-6b2d-499d-91b4-68553645649b-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89c57ac-be24-4bf8-8685-acf2dff9ed93]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Lock "cinder-0a35fe64-6b2d-499d-91b4-68553645649b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-0a35fe64-6b2d-499d-91b4-68553645649b" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-0a35fe64-6b2d-499d-91b4-68553645649b" acquired by "delete_volume" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:19 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 Nov 02 10:22:19 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb000c8-e3ba-4951-a259-7aec2bb5ddbf]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:19 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:19 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b Nov 02 10:22:19 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:20 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532" returned: 0 in 0.385s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:20 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 1G Nov 02 10:22:20 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:20 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b" returned: 0 in 0.367s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:20 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b Nov 02 10:22:20 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:20 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-0a35fe64-6b2d-499d-91b4-68553645649b" returned: 0 in 0.256s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-0a35fe64-6b2d-499d-91b4-68553645649b" released by "delete_volume" :: held 0.695s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:20 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 1G" returned: 0 in 0.442s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545c2cce-a242-4b0b-9df7-9622baf16532 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Created reservations ['4d4a12bc-1065-4b16-9642-b5e72de9dd77', '2c1ad920-b025-434f-b383-41118896ccf7', 'ebdf8d40-5210-4e7a-beb0-0656a5940608', '921a41e6-b75d-4445-b1b3-d7ec5dc0705f'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:20 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545c2cce-a242-4b0b-9df7-9622baf16532 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 Nov 02 10:22:20 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:20 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:20 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:20 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:20 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:20 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545c2cce-a242-4b0b-9df7-9622baf16532 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7" returned: 0 in 0.328s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:20 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 is being set with open permissions: ugo+rw Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:20 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:20 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.271s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:20 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:20 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Deleted volume successfully. Nov 02 10:22:20 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-62b02bb7-27f1-456b-8f54-b2d5148257a5 tempest-ProjectMemberTests-612922493 None] Lock "cinder-0a35fe64-6b2d-499d-91b4-68553645649b-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:21 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.281s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:22:21 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7" returned: 0 in 0.284s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:21 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.info Nov 02 10:22:21 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (b42a884f-0ca6-4f50-861a-cc418fca0dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799f79fd-f391-4405-8b89-913977ab1d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799f79fd-f391-4405-8b89-913977ab1d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183917268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231e16af-d4e7-464d-a39b-c1ac602ddce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:21Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f69e62f-7fab-49e0-a337-3876db29634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f69e62f-7fab-49e0-a337-3876db29634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcf3e21-feb1-4baf-8795-8d3495f37e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcf3e21-feb1-4baf-8795-8d3495f37e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231e16af-d4e7-464d-a39b-c1ac602ddce2', 'volume_name': 'volume-231e16af-d4e7-464d-a39b-c1ac602ddce2', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6366eb-1ac9-44a3-a40e-07691ef1e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6366eb-1ac9-44a3-a40e-07691ef1e13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c64cdea-5663-4f4a-b431-11cd6b138459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Volume 231e16af-d4e7-464d-a39b-c1ac602ddce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231e16af-d4e7-464d-a39b-c1ac602ddce2', 'volume_size': 1} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:21 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.info" returned: 0 in 0.293s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:21 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.info is being set with open permissions: ugo+rw Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:21 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.info Nov 02 10:22:21 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:21 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.info" returned: 0 in 0.237s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183917268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231e16af-d4e7-464d-a39b-c1ac602ddce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:21Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Creating volume 231e16af-d4e7-464d-a39b-c1ac602ddce2 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:21 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:21 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 1073741824 Nov 02 10:22:21 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:21 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-81742954-396f-4b79-b2c3-58f9cc72ef1e tempest-ProjectReaderTests-888253292 None] Create snapshot completed successfully Nov 02 10:22:22 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 1073741824" returned: 0 in 0.410s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=168,cinder:INSERT=63,cinder:UPDATE=221,cinder:DELETE=13 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=174,cinder:INSERT=58,cinder:UPDATE=216,cinder:DELETE=24 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:22 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 Nov 02 10:22:22 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:22 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2" returned: 0 in 0.262s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c64cdea-5663-4f4a-b431-11cd6b138459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231e16af-d4e7-464d-a39b-c1ac602ddce2', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e845a55f-9541-4fa4-9270-c6b50e2d611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:22 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Volume volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 (231e16af-d4e7-464d-a39b-c1ac602ddce2): created successfully Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e845a55f-9541-4fa4-9270-c6b50e2d611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (b42a884f-0ca6-4f50-861a-cc418fca0dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:22 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-789f1748-b372-44f7-83e6-267a73251b9f tempest-ProjectMemberTests-612922493 None] Created volume successfully. Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-47d274cb-ee83-40ab-be79-80109853f2e7-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Lock "cinder-47d274cb-ee83-40ab-be79-80109853f2e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-545c2cce-a242-4b0b-9df7-9622baf16532" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-545c2cce-a242-4b0b-9df7-9622baf16532" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-47d274cb-ee83-40ab-be79-80109853f2e7" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-47d274cb-ee83-40ab-be79-80109853f2e7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Deleting offline snapshot 47d274cb-ee83-40ab-be79-80109853f2e7 of volume 545c2cce-a242-4b0b-9df7-9622baf16532 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] snapshot_file for this snap is: volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[834a84ad-a734-4c37-8c04-643ad94b7959]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:23 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 Nov 02 10:22:23 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:23 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7" returned: 0 in 0.341s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-545c2cce-a242-4b0b-9df7-9622baf16532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a5d3c-f3bb-4a18-a14f-93d67920f5a1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:23 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 Nov 02 10:22:23 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Creating offline snapshot 061495d5-a393-41a4-9963-c3b4a06a5855 of volume 231e16af-d4e7-464d-a39b-c1ac602ddce2 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d6823a-5896-46dc-94d4-99ffef18507b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:23 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532" returned: 0 in 0.408s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:23 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 Nov 02 10:22:23 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:23 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 Nov 02 10:22:23 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:24 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7" returned: 0 in 0.339s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:24 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7 Nov 02 10:22:24 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:24 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2" returned: 0 in 0.419s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:24 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 1G Nov 02 10:22:24 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:24 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532.47d274cb-ee83-40ab-be79-80109853f2e7" returned: 0 in 0.247s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-47d274cb-ee83-40ab-be79-80109853f2e7" released by "_delete_snapshot" :: held 1.439s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-545c2cce-a242-4b0b-9df7-9622baf16532" released by "delete_snapshot" :: held 1.459s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Created reservations ['38360f0c-5d98-4c25-94ff-06286cfaee3a', '5a0a1ac9-07ab-4873-b9de-18ad53a63f7e', 'f7066170-9aef-43f0-b564-cb7e1b2eff30', 'd18a69c9-f1b3-472d-8ab4-eedee05c7c99'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:24 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Delete snapshot completed successfully. Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e4bc5d83-9a50-4881-be76-d09fea8c5238 tempest-ProjectReaderTests-888253292 None] Lock "cinder-47d274cb-ee83-40ab-be79-80109853f2e7-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:24 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 1G" returned: 0 in 0.442s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:24 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 Nov 02 10:22:24 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:24 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855" returned: 0 in 0.273s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:24 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 is being set with open permissions: ugo+rw Nov 02 10:22:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:24 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 Nov 02 10:22:24 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-545c2cce-a242-4b0b-9df7-9622baf16532-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Lock "cinder-545c2cce-a242-4b0b-9df7-9622baf16532-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-545c2cce-a242-4b0b-9df7-9622baf16532" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:25 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855" returned: 0 in 0.262s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-545c2cce-a242-4b0b-9df7-9622baf16532" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ca7e54-40cd-4158-838f-14d94030f6d4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:25 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.info Nov 02 10:22:25 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:25 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 Nov 02 10:22:25 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:25 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.info" returned: 0 in 0.243s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:25 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.info is being set with open permissions: ugo+rw Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:25 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.info Nov 02 10:22:25 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:25 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532" returned: 0 in 0.357s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:25 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532 Nov 02 10:22:25 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:25 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.info" returned: 0 in 0.259s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4518809e-d4b3-4e27-a0d1-74d4c6f4056a tempest-ProjectMemberTests-612922493 None] Create snapshot completed successfully Nov 02 10:22:25 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-545c2cce-a242-4b0b-9df7-9622baf16532" returned: 0 in 0.248s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-545c2cce-a242-4b0b-9df7-9622baf16532" released by "delete_volume" :: held 0.669s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Created reservations ['2135b6d2-fba8-4ddc-b2c4-ed3acd9c32fa', 'a54adf5c-a6c6-44e3-bcbc-7530574cea8f', '743f43a0-4535-43de-a89f-90e2eb878d67', '00d51651-db76-408b-82e6-420834ed2ab3'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:25 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:25 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:26 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.244s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Deleted volume successfully. Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-5b347315-f4ed-4120-880e-cf7a675ba944 tempest-ProjectReaderTests-888253292 None] Lock "cinder-545c2cce-a242-4b0b-9df7-9622baf16532-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (3df82279-0a1f-4fe2-9f56-35c97b604e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b069f0-5a73-43cd-8c93-50217a14dbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b069f0-5a73-43cd-8c93-50217a14dbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764832046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051d5685-1c14-468e-bad4-c3ca0e5f3033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:27Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42acc4b3-a6a1-4afa-86d9-d88bb1ac451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42acc4b3-a6a1-4afa-86d9-d88bb1ac451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fd5e07-d0f2-474c-affe-d51218b330b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fd5e07-d0f2-474c-affe-d51218b330b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051d5685-1c14-468e-bad4-c3ca0e5f3033', 'volume_name': 'volume-051d5685-1c14-468e-bad4-c3ca0e5f3033', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dc4310-6baa-4ef2-92e2-47fbb699072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dc4310-6baa-4ef2-92e2-47fbb699072e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee02f02-aa5c-4a0e-86cb-3c0132e5fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:26 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Volume 051d5685-1c14-468e-bad4-c3ca0e5f3033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051d5685-1c14-468e-bad4-c3ca0e5f3033', 'volume_size': 1} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764832046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051d5685-1c14-468e-bad4-c3ca0e5f3033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d888504c1c74ad6b4cdcefdfa985b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:27Z,use_quota=True,user_id='8d6abec618754656a9d2133cbb29b234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Creating volume 051d5685-1c14-468e-bad4-c3ca0e5f3033 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:26 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:26 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 1073741824 Nov 02 10:22:26 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-061495d5-a393-41a4-9963-c3b4a06a5855-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Lock "cinder-061495d5-a393-41a4-9963-c3b4a06a5855-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-231e16af-d4e7-464d-a39b-c1ac602ddce2" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-231e16af-d4e7-464d-a39b-c1ac602ddce2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-061495d5-a393-41a4-9963-c3b4a06a5855" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-061495d5-a393-41a4-9963-c3b4a06a5855" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Deleting offline snapshot 061495d5-a393-41a4-9963-c3b4a06a5855 of volume 231e16af-d4e7-464d-a39b-c1ac602ddce2 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] snapshot_file for this snap is: volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bf4abc-80d3-464c-bcbd-bb81e4c805be]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:27 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 Nov 02 10:22:27 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:27 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 1073741824" returned: 0 in 0.455s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:27 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 Nov 02 10:22:27 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:27 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855" returned: 0 in 0.393s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-231e16af-d4e7-464d-a39b-c1ac602ddce2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7caa3c-5041-4948-9998-d337f9d5a229]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:27 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 Nov 02 10:22:27 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:27 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033" returned: 0 in 0.252s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee02f02-aa5c-4a0e-86cb-3c0132e5fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051d5685-1c14-468e-bad4-c3ca0e5f3033', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de544ef-6cf2-413e-9cd2-06a8e8aa2bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:27 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Volume volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 (051d5685-1c14-468e-bad4-c3ca0e5f3033): created successfully Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de544ef-6cf2-413e-9cd2-06a8e8aa2bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Flow 'volume_create_manager' (3df82279-0a1f-4fe2-9f56-35c97b604e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:27 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ac903366-589a-4d19-a754-e291a990c736 tempest-ProjectReaderTests-888253292 None] Created volume successfully. Nov 02 10:22:27 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2" returned: 0 in 0.390s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:27 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:27 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 Nov 02 10:22:27 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:28 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855" returned: 0 in 0.317s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:28 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855 Nov 02 10:22:28 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:28 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2.061495d5-a393-41a4-9963-c3b4a06a5855" returned: 0 in 0.233s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-061495d5-a393-41a4-9963-c3b4a06a5855" released by "_delete_snapshot" :: held 1.439s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-231e16af-d4e7-464d-a39b-c1ac602ddce2" released by "delete_snapshot" :: held 1.467s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Created reservations ['0ab7106e-9646-4368-9afe-671ae1f8ed63', '6774d489-0b9e-4ac9-81ba-00d4ca0f7a89', '18f2ccc9-9cf1-4e46-beca-06e941c20a02', '17011ba4-907c-4fa4-b410-f13e59dbd97c'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:28 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Delete snapshot completed successfully. Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-07828247-27f8-4735-8d4b-87740c2a8608 tempest-ProjectMemberTests-612922493 None] Lock "cinder-061495d5-a393-41a4-9963-c3b4a06a5855-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Creating offline snapshot 60c41160-7fe3-47bc-b915-6f0c87dc398f of volume 051d5685-1c14-468e-bad4-c3ca0e5f3033 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfadfd18-f88b-45df-bcbf-b589c481489f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:28 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 Nov 02 10:22:28 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-231e16af-d4e7-464d-a39b-c1ac602ddce2-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:28 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Lock "cinder-231e16af-d4e7-464d-a39b-c1ac602ddce2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-231e16af-d4e7-464d-a39b-c1ac602ddce2" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-231e16af-d4e7-464d-a39b-c1ac602ddce2" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[26310aa9-f9e8-4660-a863-8142f0d8acd5]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:29 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 Nov 02 10:22:29 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:29 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033" returned: 0 in 0.378s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:29 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f 1G Nov 02 10:22:29 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:29 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2" returned: 0 in 0.360s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:29 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2 Nov 02 10:22:29 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:29 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f 1G" returned: 0 in 0.422s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:29 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f Nov 02 10:22:29 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:29 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-231e16af-d4e7-464d-a39b-c1ac602ddce2" returned: 0 in 0.272s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-231e16af-d4e7-464d-a39b-c1ac602ddce2" released by "delete_volume" :: held 0.695s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Created reservations ['dd810d02-7fe9-411a-b254-bc48e31c0feb', 'f51ab6c6-51e5-4df9-8330-04142e36b88e', '55278b4c-3bac-4cb9-86df-845b0d00f8e8', 'd0e0d088-9369-4fb9-ba9f-19825b6f0a83'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:29 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:29 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:29 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:30 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f" returned: 0 in 0.348s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:30 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f is being set with open permissions: ugo+rw Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:30 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f Nov 02 10:22:30 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:30 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.266s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:30 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Deleted volume successfully. Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-9660e441-6ecb-4e6a-bb27-f3b782290ffc tempest-ProjectMemberTests-612922493 None] Lock "cinder-231e16af-d4e7-464d-a39b-c1ac602ddce2-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:30 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f" returned: 0 in 0.236s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:30 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.info Nov 02 10:22:30 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:30 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.info" returned: 0 in 0.275s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:30 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.info is being set with open permissions: ugo+rw Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:30 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.info Nov 02 10:22:30 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (d1b7d636-e1d3-492e-958f-bd7a5b868cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8169845-8182-462e-8054-d3bf701675b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8169845-8182-462e-8054-d3bf701675b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1257817918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d7085f-9538-46d3-b5cd-cffdd0008263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:31Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e653ad37-e287-4100-9e07-81ce954de757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e653ad37-e287-4100-9e07-81ce954de757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784aa8b5-47e7-45d3-8668-7f9d770323ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784aa8b5-47e7-45d3-8668-7f9d770323ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d7085f-9538-46d3-b5cd-cffdd0008263', 'volume_name': 'volume-26d7085f-9538-46d3-b5cd-cffdd0008263', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766aa467-17c8-433c-8889-15d72c059b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766aa467-17c8-433c-8889-15d72c059b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8005a858-d088-4444-a8b2-f7113c8034d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:30 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Volume 26d7085f-9538-46d3-b5cd-cffdd0008263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d7085f-9538-46d3-b5cd-cffdd0008263', 'volume_size': 1} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:30 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.info" returned: 0 in 0.253s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1257817918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d7085f-9538-46d3-b5cd-cffdd0008263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:31Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Creating volume 26d7085f-9538-46d3-b5cd-cffdd0008263 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:30 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:30 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:30 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 1073741824 Nov 02 10:22:30 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:30 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-22515777-7dac-4d52-9ba7-b504b5238963 tempest-ProjectReaderTests-888253292 None] Create snapshot completed successfully Nov 02 10:22:31 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 1073741824" returned: 0 in 0.410s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:31 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 Nov 02 10:22:31 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:31 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263" returned: 0 in 0.244s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8005a858-d088-4444-a8b2-f7113c8034d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d7085f-9538-46d3-b5cd-cffdd0008263', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9180890d-fb2b-4f59-be60-89e3f9c8e918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:31 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Volume volume-26d7085f-9538-46d3-b5cd-cffdd0008263 (26d7085f-9538-46d3-b5cd-cffdd0008263): created successfully Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9180890d-fb2b-4f59-be60-89e3f9c8e918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (d1b7d636-e1d3-492e-958f-bd7a5b868cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:31 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a2711edd-f811-4b76-9c87-0a5d474f0f0e tempest-ProjectMemberTests-612922493 None] Created volume successfully. Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-60c41160-7fe3-47bc-b915-6f0c87dc398f-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Lock "cinder-60c41160-7fe3-47bc-b915-6f0c87dc398f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:31 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-051d5685-1c14-468e-bad4-c3ca0e5f3033" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-051d5685-1c14-468e-bad4-c3ca0e5f3033" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-60c41160-7fe3-47bc-b915-6f0c87dc398f" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-60c41160-7fe3-47bc-b915-6f0c87dc398f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Deleting offline snapshot 60c41160-7fe3-47bc-b915-6f0c87dc398f of volume 051d5685-1c14-468e-bad4-c3ca0e5f3033 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] snapshot_file for this snap is: volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe9f0d5-90af-485a-930c-b0758422d528]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:32 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f Nov 02 10:22:32 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:32 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f" returned: 0 in 0.337s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051d5685-1c14-468e-bad4-c3ca0e5f3033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[520cde56-43b8-4fba-93af-06088c9ffdec]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:32 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 Nov 02 10:22:32 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:32 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:32 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f Nov 02 10:22:32 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Creating offline snapshot 755a5a6c-dd19-4bfd-8d56-c745367aa174 of volume 26d7085f-9538-46d3-b5cd-cffdd0008263 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff83d8d3-a8ff-4772-a6e6-d145ea53cee1]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:32 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:32 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 Nov 02 10:22:32 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:33 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f" returned: 0 in 0.341s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:33 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f Nov 02 10:22:33 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:33 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263" returned: 0 in 0.374s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:33 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 1G Nov 02 10:22:33 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:33 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033.60c41160-7fe3-47bc-b915-6f0c87dc398f" returned: 0 in 0.248s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-60c41160-7fe3-47bc-b915-6f0c87dc398f" released by "_delete_snapshot" :: held 1.378s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-051d5685-1c14-468e-bad4-c3ca0e5f3033" released by "delete_snapshot" :: held 1.398s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Created reservations ['5614d4d3-6691-42bc-bce5-ed951f584078', 'ec1c8441-69ad-4459-a0b2-3993cf56b524', 'f3e274a2-fe10-4fa3-a201-5baf2bd29e2d', '35e2cd6d-dbb8-4e26-b6dd-5e56acfee4b7'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:33 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Delete snapshot completed successfully. Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-1bc0926b-be47-4f6f-8b11-ce15b78a052b tempest-ProjectReaderTests-888253292 None] Lock "cinder-60c41160-7fe3-47bc-b915-6f0c87dc398f-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:33 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 1G" returned: 0 in 0.399s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26d7085f-9538-46d3-b5cd-cffdd0008263 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:33 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26d7085f-9538-46d3-b5cd-cffdd0008263 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 Nov 02 10:22:33 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:33 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26d7085f-9538-46d3-b5cd-cffdd0008263 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174" returned: 0 in 0.269s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:33 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 is being set with open permissions: ugo+rw Nov 02 10:22:33 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:33 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 Nov 02 10:22:33 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-051d5685-1c14-468e-bad4-c3ca0e5f3033-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Lock "cinder-051d5685-1c14-468e-bad4-c3ca0e5f3033-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:34 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174" returned: 0 in 0.240s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Acquiring lock "cinder-quobyte-051d5685-1c14-468e-bad4-c3ca0e5f3033" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:34 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.info Nov 02 10:22:34 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-051d5685-1c14-468e-bad4-c3ca0e5f3033" acquired by "delete_volume" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38924cc-2df5-4bd4-889b-328ccbc3206e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:34 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 Nov 02 10:22:34 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:34 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.info" returned: 0 in 0.251s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:34 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.info is being set with open permissions: ugo+rw Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:34 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.info Nov 02 10:22:34 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:34 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033" returned: 0 in 0.368s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:34 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033 Nov 02 10:22:34 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:34 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.info" returned: 0 in 0.246s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:34 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4027d7b1-27f8-4344-bf54-096b7188b5b7 tempest-ProjectMemberTests-612922493 None] Create snapshot completed successfully Nov 02 10:22:34 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-051d5685-1c14-468e-bad4-c3ca0e5f3033" returned: 0 in 0.254s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Lock "cinder-quobyte-051d5685-1c14-468e-bad4-c3ca0e5f3033" released by "delete_volume" :: held 0.681s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Created reservations ['27bc2693-6360-425e-8944-b0bcdeddcd9e', 'a3459b31-11c4-4ed4-8548-e659a4bc57dc', '6d743225-9811-4993-b2cc-d0f19dd19411', '4f7e2748-3e25-4b47-a1da-3579c512be84'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-755a5a6c-dd19-4bfd-8d56-c745367aa174-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Lock "cinder-755a5a6c-dd19-4bfd-8d56-c745367aa174-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:34 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-26d7085f-9538-46d3-b5cd-cffdd0008263" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-26d7085f-9538-46d3-b5cd-cffdd0008263" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-755a5a6c-dd19-4bfd-8d56-c745367aa174" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-755a5a6c-dd19-4bfd-8d56-c745367aa174" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Deleting offline snapshot 755a5a6c-dd19-4bfd-8d56-c745367aa174 of volume 26d7085f-9538-46d3-b5cd-cffdd0008263 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] snapshot_file for this snap is: volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6affed65-eb48-4edb-8958-ce2a00804607]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:35 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:35 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:35 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 Nov 02 10:22:35 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:35 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.246s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:35 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Deleted volume successfully. Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-55f84c39-9e7b-4922-863a-d9fb5561cbf8 tempest-ProjectReaderTests-888253292 None] Lock "cinder-051d5685-1c14-468e-bad4-c3ca0e5f3033-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:35 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174" returned: 0 in 0.376s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26d7085f-9538-46d3-b5cd-cffdd0008263(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12a9766-7d21-425c-b202-84fe100885b2]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:35 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 Nov 02 10:22:35 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:35 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263" returned: 0 in 0.391s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:35 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:35 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 Nov 02 10:22:35 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:36 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174" returned: 0 in 0.363s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:36 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174 Nov 02 10:22:36 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:36 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:36 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263.755a5a6c-dd19-4bfd-8d56-c745367aa174" returned: 0 in 0.270s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-755a5a6c-dd19-4bfd-8d56-c745367aa174" released by "_delete_snapshot" :: held 1.515s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-26d7085f-9538-46d3-b5cd-cffdd0008263" released by "delete_snapshot" :: held 1.541s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:36 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Created reservations ['7329eee6-d914-45ec-bdf7-c38a319759d9', '4a25051a-e7cd-41ad-a16a-9993bcced7f6', '2018dea2-3494-4af5-8eb3-a550a4869891', '62920239-f456-439e-85ac-19ec6ad09971'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:36 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Delete snapshot completed successfully. Nov 02 10:22:36 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-3f8a4a28-2f06-4d00-819e-cfc4315a7bda tempest-ProjectMemberTests-612922493 None] Lock "cinder-755a5a6c-dd19-4bfd-8d56-c745367aa174-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-26d7085f-9538-46d3-b5cd-cffdd0008263-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-26d7085f-9538-46d3-b5cd-cffdd0008263-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-26d7085f-9538-46d3-b5cd-cffdd0008263" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-26d7085f-9538-46d3-b5cd-cffdd0008263" acquired by "delete_volume" :: waited 0.027s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e729010-6026-4e9f-961b-91b6df51c535]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:37 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 Nov 02 10:22:37 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:37 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263" returned: 0 in 0.381s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:37 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263 Nov 02 10:22:37 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:37 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-26d7085f-9538-46d3-b5cd-cffdd0008263" returned: 0 in 0.241s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-26d7085f-9538-46d3-b5cd-cffdd0008263" released by "delete_volume" :: held 0.691s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:37 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Created reservations ['8c2f9738-4232-412f-b65f-8842edaae69b', '418aa361-c760-4493-be43-405aa29b1072', '725f621b-b2ed-4e63-9c47-06ac4a7ef4f4', 'b09a7a49-ce58-4a70-82ba-bd48c935ca2a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:38 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:38 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:38 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.237s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:38 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Deleted volume successfully. Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-aaff9e56-6f3b-4982-91bb-fc93bda0c5a9 tempest-ProjectMemberTests-612922493 None] Lock "cinder-26d7085f-9538-46d3-b5cd-cffdd0008263-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (467f197a-a982-47be-8aa8-9688ed5fd09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5993dd36-d21b-44e8-8d15-055fcd91c94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5993dd36-d21b-44e8-8d15-055fcd91c94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566468735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2742082-67c2-4ea1-a7da-f85490e6f178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:39Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4667dfc-78a4-4ef6-8768-803007bcd474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4667dfc-78a4-4ef6-8768-803007bcd474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4a5550-1d15-4e0e-9f98-d2842b85cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4a5550-1d15-4e0e-9f98-d2842b85cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2742082-67c2-4ea1-a7da-f85490e6f178', 'volume_name': 'volume-b2742082-67c2-4ea1-a7da-f85490e6f178', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19af6f0-8446-48e3-948e-f0f1dd523b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19af6f0-8446-48e3-948e-f0f1dd523b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a53ec18-36db-4a40-b9ac-3c43ad1ea8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:38 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Volume b2742082-67c2-4ea1-a7da-f85490e6f178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2742082-67c2-4ea1-a7da-f85490e6f178', 'volume_size': 1} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566468735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2742082-67c2-4ea1-a7da-f85490e6f178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:39Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Creating volume b2742082-67c2-4ea1-a7da-f85490e6f178 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:38 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:38 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:38 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 1073741824 Nov 02 10:22:38 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:39 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 1073741824" returned: 0 in 0.436s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:39 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 Nov 02 10:22:39 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:39 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178" returned: 0 in 0.263s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:39 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:39 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a53ec18-36db-4a40-b9ac-3c43ad1ea8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2742082-67c2-4ea1-a7da-f85490e6f178', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f5ca6f-7fd1-45c8-82bd-148337ad455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:39 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Volume volume-b2742082-67c2-4ea1-a7da-f85490e6f178 (b2742082-67c2-4ea1-a7da-f85490e6f178): created successfully Nov 02 10:22:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f5ca6f-7fd1-45c8-82bd-148337ad455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:39 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (467f197a-a982-47be-8aa8-9688ed5fd09f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:39 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-32cbaa3d-8212-4666-8ebc-69eff92c5ab1 tempest-ProjectMemberTests-612922493 None] Created volume successfully. Nov 02 10:22:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:40 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Creating offline snapshot a2df522b-d917-44bb-8137-4295aae7b297 of volume b2742082-67c2-4ea1-a7da-f85490e6f178 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:40 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3941986f-d4e6-439b-abe8-2f4c575e16e4]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:40 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 Nov 02 10:22:40 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:40 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178" returned: 0 in 0.361s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:40 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 1G Nov 02 10:22:40 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:40 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 1G" returned: 0 in 0.462s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:40 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2742082-67c2-4ea1-a7da-f85490e6f178 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:40 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2742082-67c2-4ea1-a7da-f85490e6f178 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 Nov 02 10:22:40 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:41 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2742082-67c2-4ea1-a7da-f85490e6f178 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297" returned: 0 in 0.313s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:41 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 is being set with open permissions: ugo+rw Nov 02 10:22:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:41 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 Nov 02 10:22:41 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:41 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297" returned: 0 in 0.239s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:41 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.info Nov 02 10:22:41 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:41 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.info" returned: 0 in 0.289s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:41 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.info is being set with open permissions: ugo+rw Nov 02 10:22:41 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:41 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.info Nov 02 10:22:41 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:41 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.info" returned: 0 in 0.247s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:42 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:42 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e6f6d7bf-bd24-4954-bfca-237e5eb31ce3 tempest-ProjectMemberTests-612922493 None] Create snapshot completed successfully Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-a2df522b-d917-44bb-8137-4295aae7b297-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Lock "cinder-a2df522b-d917-44bb-8137-4295aae7b297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-b2742082-67c2-4ea1-a7da-f85490e6f178" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-b2742082-67c2-4ea1-a7da-f85490e6f178" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-a2df522b-d917-44bb-8137-4295aae7b297" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-a2df522b-d917-44bb-8137-4295aae7b297" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Deleting offline snapshot a2df522b-d917-44bb-8137-4295aae7b297 of volume b2742082-67c2-4ea1-a7da-f85490e6f178 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] snapshot_file for this snap is: volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb36f37a-820e-4b0d-8e96-69c4ec9efb50]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:43 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 Nov 02 10:22:43 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:43 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297" returned: 0 in 0.417s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2742082-67c2-4ea1-a7da-f85490e6f178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0a09c2-cd30-4e17-8184-fa3ad263cc14]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:43 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:43 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 Nov 02 10:22:43 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:44 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178" returned: 0 in 0.403s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:44 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 Nov 02 10:22:44 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:44 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297" returned: 0 in 0.417s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:44 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297 Nov 02 10:22:44 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:44 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:44 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178.a2df522b-d917-44bb-8137-4295aae7b297" returned: 0 in 0.333s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:44 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-a2df522b-d917-44bb-8137-4295aae7b297" released by "_delete_snapshot" :: held 1.685s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:44 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-b2742082-67c2-4ea1-a7da-f85490e6f178" released by "delete_snapshot" :: held 1.712s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Created reservations ['ccc53b31-3456-4ac3-af55-47c6011aee3f', '89f62e6f-2418-475c-8ed3-4b591d5c6543', '13e5a279-8f01-41b7-a107-6494142ce800', '31f31d08-314f-4b14-81ef-16c53a14e017'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:45 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Delete snapshot completed successfully. Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-81f7e86d-8872-4c23-9447-22e093b3175f tempest-ProjectMemberTests-612922493 None] Lock "cinder-a2df522b-d917-44bb-8137-4295aae7b297-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-b2742082-67c2-4ea1-a7da-f85490e6f178-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Lock "cinder-b2742082-67c2-4ea1-a7da-f85490e6f178-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-b2742082-67c2-4ea1-a7da-f85490e6f178" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-b2742082-67c2-4ea1-a7da-f85490e6f178" acquired by "delete_volume" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[616bdc4b-92af-4dfd-969b-6e174669affb]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:45 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 Nov 02 10:22:45 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:45 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178" returned: 0 in 0.452s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:45 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:46 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178 Nov 02 10:22:46 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:46 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-b2742082-67c2-4ea1-a7da-f85490e6f178" returned: 0 in 0.269s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-b2742082-67c2-4ea1-a7da-f85490e6f178" released by "delete_volume" :: held 0.816s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Created reservations ['90087576-4e59-4516-9d93-c36eba6b3ade', '64982a98-8ea0-4612-8283-14c54f5ec9e7', '939cfa0a-8b71-49a5-9588-c25ecd235e44', 'f85294ae-ba39-4464-b448-66f3d9f9cec7'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:46 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:46 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:46 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.299s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:46 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Deleted volume successfully. Nov 02 10:22:46 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-a37226a8-30e4-4d8f-b05a-dd8cecf39905 tempest-ProjectMemberTests-612922493 None] Lock "cinder-b2742082-67c2-4ea1-a7da-f85490e6f178-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (46db7921-2918-4da6-8749-6eb213d0c2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6976548-3aa6-4124-820b-6ce70bf478d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6976548-3aa6-4124-820b-6ce70bf478d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113932203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29f5c4f-781a-42b8-8d74-7df2ba1edda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:47Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b6f4f1-9529-46c1-accb-6d185c7b6045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b6f4f1-9529-46c1-accb-6d185c7b6045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c55493f-56fa-489d-b1a9-0d966fd114b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c55493f-56fa-489d-b1a9-0d966fd114b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29f5c4f-781a-42b8-8d74-7df2ba1edda6', 'volume_name': 'volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d45be7-d270-4f8d-8ed2-375427abe539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d45be7-d270-4f8d-8ed2-375427abe539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198679a7-11ed-4d3f-9a81-39d4dd556e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:47 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Volume e29f5c4f-781a-42b8-8d74-7df2ba1edda6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6', 'volume_size': 1} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113932203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29f5c4f-781a-42b8-8d74-7df2ba1edda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:47Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Creating volume e29f5c4f-781a-42b8-8d74-7df2ba1edda6 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:47 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:47 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 1073741824 Nov 02 10:22:47 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:47 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 1073741824" returned: 0 in 0.477s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:47 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 Nov 02 10:22:47 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:47 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" returned: 0 in 0.263s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198679a7-11ed-4d3f-9a81-39d4dd556e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:47 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d33c4a-1ab6-4b9a-b85f-6e70eb704a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:48 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Volume volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 (e29f5c4f-781a-42b8-8d74-7df2ba1edda6): created successfully Nov 02 10:22:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d33c4a-1ab6-4b9a-b85f-6e70eb704a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:48 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (46db7921-2918-4da6-8749-6eb213d0c2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:48 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-37d2ff02-cb89-4252-8760-08b6f27548d1 tempest-ProjectMemberTests-612922493 None] Created volume successfully. Nov 02 10:22:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:49 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Creating offline snapshot bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 of volume e29f5c4f-781a-42b8-8d74-7df2ba1edda6 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:49 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0bb403-fc31-4f1e-b70d-a9c8a13485d0]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:49 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 Nov 02 10:22:49 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:49 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" returned: 0 in 0.389s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:49 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:49 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 1G Nov 02 10:22:49 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:50 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 1G" returned: 0 in 0.421s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:50 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 Nov 02 10:22:50 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:50 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3" returned: 0 in 0.299s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:50 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 is being set with open permissions: ugo+rw Nov 02 10:22:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:50 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 Nov 02 10:22:50 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:50 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3" returned: 0 in 0.279s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:50 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:50 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.info Nov 02 10:22:50 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:51 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.info" returned: 0 in 0.261s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:51 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.info is being set with open permissions: ugo+rw Nov 02 10:22:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:51 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.info Nov 02 10:22:51 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:51 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.info" returned: 0 in 0.278s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:51 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:51 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-537a6c17-6209-4291-8478-6479e19a75f5 tempest-ProjectMemberTests-612922493 None] Create snapshot completed successfully Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Lock "cinder-bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Deleting offline snapshot bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 of volume e29f5c4f-781a-42b8-8d74-7df2ba1edda6 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] snapshot_file for this snap is: volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f8c25-5b6f-4c63-897d-4d0abae85c3e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:52 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 Nov 02 10:22:52 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:52 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3" returned: 0 in 0.359s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:52 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:22:53 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b568e9-4a3f-45f8-a148-dbc5679bb9cc]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:53 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 Nov 02 10:22:53 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:53 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" returned: 0 in 0.363s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:53 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 Nov 02 10:22:53 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:53 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3" returned: 0 in 0.346s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:53 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3 Nov 02 10:22:53 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:53 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:53 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6.bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3" returned: 0 in 0.233s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3" released by "_delete_snapshot" :: held 1.399s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" released by "delete_snapshot" :: held 1.420s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Created reservations ['c518ba07-8d36-45a1-a78e-bf1fee48ab02', '730fc1c3-3a10-4c9d-8783-43240b15d66c', '344fdc96-e4ea-4654-982a-392453dab715', '6d76fa89-20cb-4bb7-bf56-693b54e0012a'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:54 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Delete snapshot completed successfully. Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8e67d6a3-1e43-4d00-8be5-d38a0deeb2a8 tempest-ProjectMemberTests-612922493 None] Lock "cinder-bbc07d9a-f0b8-4e5c-a52a-9d0e101903a3-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-e29f5c4f-781a-42b8-8d74-7df2ba1edda6-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Lock "cinder-e29f5c4f-781a-42b8-8d74-7df2ba1edda6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36e0508-3482-442c-a66d-e0c725285eaf]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:54 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:54 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 Nov 02 10:22:54 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:55 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" returned: 0 in 0.376s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:55 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6 Nov 02 10:22:55 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:55 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" returned: 0 in 0.242s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-e29f5c4f-781a-42b8-8d74-7df2ba1edda6" released by "delete_volume" :: held 0.680s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Created reservations ['ebc24c88-85ff-4d2f-a70f-b82e99f73de2', '5febe53e-d3d8-4d90-b9e1-ed62ae046811', '3418ef02-de41-4510-a53e-627899356215', 'eba7127c-f462-447c-894d-a1fe7596ac89'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:55 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:22:55 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:55 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.241s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:22:55 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Deleted volume successfully. Nov 02 10:22:55 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-4742de9a-f983-484a-974a-6c53c3cf1d9e tempest-ProjectMemberTests-612922493 None] Lock "cinder-e29f5c4f-781a-42b8-8d74-7df2ba1edda6-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (601ed1d9-4139-47e3-91d3-51e06f2825be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f02aaf-9e4f-4e3e-ae14-673f4c278ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f02aaf-9e4f-4e3e-ae14-673f4c278ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685948246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1035271c-5be1-4c6f-93b9-8d6f42b9fa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:56Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44262cc2-e082-4c8c-8646-27f038a6f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44262cc2-e082-4c8c-8646-27f038a6f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950f9791-454c-41fb-8cb6-5e14b4389966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950f9791-454c-41fb-8cb6-5e14b4389966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1035271c-5be1-4c6f-93b9-8d6f42b9fa29', 'volume_name': 'volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab3e3e4-982f-4747-a32d-14d4dc3a270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab3e3e4-982f-4747-a32d-14d4dc3a270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c751199-9cdc-47f1-8243-8874583f764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:56 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Volume 1035271c-5be1-4c6f-93b9-8d6f42b9fa29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29', 'volume_size': 1} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-685948246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1035271c-5be1-4c6f-93b9-8d6f42b9fa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:56Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Creating volume 1035271c-5be1-4c6f-93b9-8d6f42b9fa29 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:22:56 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:56 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 1073741824 Nov 02 10:22:56 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:56 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 1073741824" returned: 0 in 0.424s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:56 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:56 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 Nov 02 10:22:56 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:57 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" returned: 0 in 0.247s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c751199-9cdc-47f1-8243-8874583f764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7feb74-e33c-49f3-9a5a-5bda04b65d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:22:57 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Volume volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 (1035271c-5be1-4c6f-93b9-8d6f42b9fa29): created successfully Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7feb74-e33c-49f3-9a5a-5bda04b65d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (601ed1d9-4139-47e3-91d3-51e06f2825be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:22:57 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-ffaefa8b-0399-478f-a24c-dbe18f142b48 tempest-ProjectMemberTests-612922493 None] Created volume successfully. Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Creating offline snapshot 3e46362b-1c09-42a5-b996-77148201ab87 of volume 1035271c-5be1-4c6f-93b9-8d6f42b9fa29 {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b805a5ee-ee4f-4d6b-b2b8-a87a3ef88a6b]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:57 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 Nov 02 10:22:57 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:57 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" returned: 0 in 0.385s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:57 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:57 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 1G Nov 02 10:22:57 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:58 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 1G" returned: 0 in 0.378s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:58 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 Nov 02 10:22:58 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:58 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87" returned: 0 in 0.285s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:58 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 is being set with open permissions: ugo+rw Nov 02 10:22:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:58 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 Nov 02 10:22:58 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:58 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87" returned: 0 in 0.232s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:58 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:58 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.info Nov 02 10:22:58 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:59 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.info" returned: 0 in 0.246s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:59 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.info is being set with open permissions: ugo+rw Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:59 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.info Nov 02 10:22:59 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:22:59 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.info" returned: 0 in 0.239s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:22:59 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8131c3fb-f4a3-443f-8c2a-0584500ab04f tempest-ProjectMemberTests-612922493 None] Create snapshot completed successfully Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-3e46362b-1c09-42a5-b996-77148201ab87-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Lock "cinder-3e46362b-1c09-42a5-b996-77148201ab87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-3e46362b-1c09-42a5-b996-77148201ab87" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-3e46362b-1c09-42a5-b996-77148201ab87" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Deleting offline snapshot 3e46362b-1c09-42a5-b996-77148201ab87 of volume 1035271c-5be1-4c6f-93b9-8d6f42b9fa29 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] snapshot_file for this snap is: volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e1e843-56e1-413e-81f5-f262e267e266]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:22:59 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:22:59 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 Nov 02 10:22:59 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:00 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87" returned: 0 in 0.363s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:00 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:23:00 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9738e96d-2204-4038-8b9d-905e4e747e55]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:00 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 Nov 02 10:23:00 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:00 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" returned: 0 in 0.357s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:00 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 Nov 02 10:23:00 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:00 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87" returned: 0 in 0.319s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:00 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:00 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87 Nov 02 10:23:00 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:01 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29.3e46362b-1c09-42a5-b996-77148201ab87" returned: 0 in 0.234s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-3e46362b-1c09-42a5-b996-77148201ab87" released by "_delete_snapshot" :: held 1.365s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" released by "delete_snapshot" :: held 1.386s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Created reservations ['19a3105f-1daf-45cd-b72d-4dc738107d6e', 'd0ba570e-dc59-442a-8960-e35c5aa52501', '92f9936f-5ac7-4446-8430-9f7885eb138c', '263c752f-6feb-4301-b341-56cdcce09f7f'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:01 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Delete snapshot completed successfully. Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-f010dec8-9a67-4a52-ad92-9cce0fbf1158 tempest-ProjectMemberTests-612922493 None] Lock "cinder-3e46362b-1c09-42a5-b996-77148201ab87-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-1035271c-5be1-4c6f-93b9-8d6f42b9fa29-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Lock "cinder-1035271c-5be1-4c6f-93b9-8d6f42b9fa29-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[419e5467-7a66-4512-827c-a23f964ceb49]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:01 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:02 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 Nov 02 10:23:02 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:02 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" returned: 0 in 0.352s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:02 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29 Nov 02 10:23:02 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:02 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" returned: 0 in 0.242s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-1035271c-5be1-4c6f-93b9-8d6f42b9fa29" released by "delete_volume" :: held 0.664s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Created reservations ['f94979af-3d60-4248-aea1-e859e651c42c', '5db6cabd-c056-4b56-beed-b89872c741ce', '59847f00-28c7-4cfc-bcca-b5f7532c923b', '6c862d37-73db-49cc-9cfb-4ea722edfc16'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:02 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:23:02 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:02 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.234s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:02 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Deleted volume successfully. Nov 02 10:23:02 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-737e1e1e-e89d-4d39-ad85-c7b0f26c528d tempest-ProjectMemberTests-612922493 None] Lock "cinder-1035271c-5be1-4c6f-93b9-8d6f42b9fa29-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (0d5b453d-e9f0-4068-931a-ade91419d888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c32d2df-74b9-4ed7-9c66-ba313789c045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c32d2df-74b9-4ed7-9c66-ba313789c045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292976690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c439ed15-3aec-46a3-9add-4977848f0a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:03Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f924ad-37bb-4b61-816d-a12cef3ef99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f924ad-37bb-4b61-816d-a12cef3ef99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047853bc-58f4-473c-96fe-27b19e20f70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047853bc-58f4-473c-96fe-27b19e20f70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c439ed15-3aec-46a3-9add-4977848f0a4f', 'volume_name': 'volume-c439ed15-3aec-46a3-9add-4977848f0a4f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b50166-dd16-47be-a7b5-c56aa5b2e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b50166-dd16-47be-a7b5-c56aa5b2e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c29ea3c-32d6-4de8-967f-7843bab27e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:03 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Volume c439ed15-3aec-46a3-9add-4977848f0a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c439ed15-3aec-46a3-9add-4977848f0a4f', 'volume_size': 1} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292976690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c439ed15-3aec-46a3-9add-4977848f0a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f7ad114f0e43dbbdb7ee738bf30588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:03Z,use_quota=True,user_id='fea632e8cb32459a82116f14be329057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Creating volume c439ed15-3aec-46a3-9add-4977848f0a4f {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:03 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:03 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f 1073741824 Nov 02 10:23:03 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:03 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f 1073741824" returned: 0 in 0.410s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:03 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:03 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f Nov 02 10:23:03 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:04 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f" returned: 0 in 0.227s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c29ea3c-32d6-4de8-967f-7843bab27e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c439ed15-3aec-46a3-9add-4977848f0a4f', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7032138b-1484-47d8-b15d-a9a63fdafd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:04 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Volume volume-c439ed15-3aec-46a3-9add-4977848f0a4f (c439ed15-3aec-46a3-9add-4977848f0a4f): created successfully Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7032138b-1484-47d8-b15d-a9a63fdafd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Flow 'volume_create_manager' (0d5b453d-e9f0-4068-931a-ade91419d888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:04 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-20ed40d3-00db-485e-8964-9e369506b943 tempest-ProjectMemberTests-612922493 None] Created volume successfully. Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Creating offline snapshot c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 of volume c439ed15-3aec-46a3-9add-4977848f0a4f {{(pid=86840) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[044fc27a-0210-4611-9ea9-446340e4150e]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:04 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f Nov 02 10:23:04 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:04 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f" returned: 0 in 0.390s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:04 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 1G {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:04 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 1G Nov 02 10:23:05 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:05 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 1G" returned: 0 in 0.393s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c439ed15-3aec-46a3-9add-4977848f0a4f -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:05 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c439ed15-3aec-46a3-9add-4977848f0a4f -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 Nov 02 10:23:05 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:05 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c439ed15-3aec-46a3-9add-4977848f0a4f -F qcow2 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708" returned: 0 in 0.280s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:05 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 is being set with open permissions: ugo+rw Nov 02 10:23:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:05 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 Nov 02 10:23:05 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:05 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708" returned: 0 in 0.230s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:05 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:05 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.info Nov 02 10:23:05 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:06 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.info" returned: 0 in 0.254s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:06 devstack cinder-volume[86840]: WARNING cinder.volume.drivers.remotefs [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.info is being set with open permissions: ugo+rw Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.info {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:06 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.info Nov 02 10:23:06 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:06 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.info" returned: 0 in 0.232s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:06 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-3c9df9e6-83a3-49c4-912f-086608387fc9 tempest-ProjectMemberTests-612922493 None] Create snapshot completed successfully Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-c944d9d2-c4ee-43ce-ad05-fb9ba1c88708-delete_snapshot" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Lock "cinder-c944d9d2-c4ee-43ce-ad05-fb9ba1c88708-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-c439ed15-3aec-46a3-9add-4977848f0a4f" by "delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-c439ed15-3aec-46a3-9add-4977848f0a4f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-c944d9d2-c4ee-43ce-ad05-fb9ba1c88708" by "_delete_snapshot" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-c944d9d2-c4ee-43ce-ad05-fb9ba1c88708" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Deleting offline snapshot c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 of volume c439ed15-3aec-46a3-9add-4977848f0a4f {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] snapshot_file for this snap is: volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 {{(pid=86840) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7efcfdb-303e-4760-b017-d1b433d5087f]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:06 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:06 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 Nov 02 10:23:06 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:07 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708" returned: 0 in 0.346s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:07 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c439ed15-3aec-46a3-9add-4977848f0a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86840) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:23:07 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e8331d-8964-4931-9b7f-6eeabf265995]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:07 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f Nov 02 10:23:07 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:07 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f" returned: 0 in 0.367s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:07 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 Nov 02 10:23:07 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:07 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708" returned: 0 in 0.342s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:07 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:07 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708 Nov 02 10:23:07 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:08 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:08 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f.c944d9d2-c4ee-43ce-ad05-fb9ba1c88708" returned: 0 in 0.233s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-c944d9d2-c4ee-43ce-ad05-fb9ba1c88708" released by "_delete_snapshot" :: held 1.385s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-c439ed15-3aec-46a3-9add-4977848f0a4f" released by "delete_snapshot" :: held 1.409s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:08 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Created reservations ['6eef3c84-1d31-497c-8230-5c87b43492ee', 'f02f67e5-a8de-4e17-bd9e-745ca806fa46', '4a310ff5-ef4c-42b3-81e3-59f572ebcf3a', 'c9e82398-c7d9-475d-bb2b-fcddd7471fde'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:08 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Delete snapshot completed successfully. Nov 02 10:23:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-e6047157-9a45-479a-863e-24f860215f4c tempest-ProjectMemberTests-612922493 None] Lock "cinder-c944d9d2-c4ee-43ce-ad05-fb9ba1c88708-delete_snapshot" released by "delete_snapshot" :: held 1.541s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-c439ed15-3aec-46a3-9add-4977848f0a4f-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Lock "cinder-c439ed15-3aec-46a3-9add-4977848f0a4f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Acquiring lock "cinder-quobyte-c439ed15-3aec-46a3-9add-4977848f0a4f" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:08 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-c439ed15-3aec-46a3-9add-4977848f0a4f" acquired by "delete_volume" :: waited 0.014s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd323f4-39d2-4c1d-925d-cd7743964b33]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:09 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f Nov 02 10:23:09 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:09 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f" returned: 0 in 0.344s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:09 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f Nov 02 10:23:09 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:09 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-c439ed15-3aec-46a3-9add-4977848f0a4f" returned: 0 in 0.243s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Lock "cinder-quobyte-c439ed15-3aec-46a3-9add-4977848f0a4f" released by "delete_volume" :: held 0.647s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Created reservations ['398e4e5e-39a2-4a43-83df-29eeb5bd814c', 'fcec3b23-e292-4dba-8405-82c317c5a0ff', '45b09dcf-1dc4-4cd7-a363-f2281a11a668', '83bede8a-8179-4030-b041-43630882b18b'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:09 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:23:09 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:09 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.242s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:09 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:10 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Deleted volume successfully. Nov 02 10:23:10 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-11e402d2-3a66-4cca-ad87-03cac5dbf49e tempest-ProjectMemberTests-612922493 None] Lock "cinder-c439ed15-3aec-46a3-9add-4977848f0a4f-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:19 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=112,cinder:INSERT=45,cinder:UPDATE=147,cinder:DELETE=10 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:23:20 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:DELETE=12,cinder:UPDATE=130,cinder:SELECT=100,cinder:INSERT=33 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:23:20 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:23:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:20 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:20 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:20 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:23:20 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:21 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.262s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG oslo_service.periodic_task [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] Running periodic task VolumeManager._thread_info {{(pid=86840) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread count: 28 {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-cdc66d3a-1e84-412b-a956-3e92beaff263 None None] thread info: [<_MainThread(MainThread, started 131130872283264)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86840) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Flow 'volume_create_manager' (b86406ae-08c0-47e6-b415-e0a480c616c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b77ae-4472-4df5-b1cf-8bd7337e197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b77ae-4472-4df5-b1cf-8bd7337e197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725039988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f1bd25-5b9e-43a1-ad61-bef75a3c36f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddcee4f2f4643018b45496bddd73b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:22Z,use_quota=True,user_id='4439f5e6910245bab75dc11e87ffc799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acb20d7-d0b0-4c8d-b901-6754f492417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5acb20d7-d0b0-4c8d-b901-6754f492417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b22b6fd-54d4-4569-b75d-08b1ec9b2527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b22b6fd-54d4-4569-b75d-08b1ec9b2527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f1bd25-5b9e-43a1-ad61-bef75a3c36f2', 'volume_name': 'volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375828c5-febc-4ef3-a559-2f082c980b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375828c5-febc-4ef3-a559-2f082c980b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea58ca84-2811-48a8-a4ca-628755512cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:21 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Volume 37f1bd25-5b9e-43a1-ad61-bef75a3c36f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2', 'volume_size': 1} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725039988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f1bd25-5b9e-43a1-ad61-bef75a3c36f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddcee4f2f4643018b45496bddd73b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:22Z,use_quota=True,user_id='4439f5e6910245bab75dc11e87ffc799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Creating volume 37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:21 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:23:21 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:22 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 1073741824 Nov 02 10:23:22 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:22 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 1073741824" returned: 0 in 0.396s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:22 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 Nov 02 10:23:22 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:22 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2" returned: 0 in 0.241s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:22 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:22 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea58ca84-2811-48a8-a4ca-628755512cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158a0515-f670-47d6-82a2-9949e90328fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:22 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Volume volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 (37f1bd25-5b9e-43a1-ad61-bef75a3c36f2): created successfully Nov 02 10:23:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158a0515-f670-47d6-82a2-9949e90328fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:22 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Flow 'volume_create_manager' (b86406ae-08c0-47e6-b415-e0a480c616c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:22 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-9fa7c667-b1a9-41ef-a02d-08f1a7cecc1f tempest-ProjectReaderTests-768880665 None] Created volume successfully. Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Acquiring lock "cinder-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Lock "cinder-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Acquiring lock "cinder-quobyte-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Lock "cinder-quobyte-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[886a9da9-f9fd-466c-ad79-31f54ad94ebd]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:23 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 Nov 02 10:23:23 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:23 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2" returned: 0 in 0.345s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:23 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2 Nov 02 10:23:23 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:23 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2" returned: 0 in 0.236s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Lock "cinder-quobyte-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2" released by "delete_volume" :: held 0.621s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Created reservations ['03ed75c2-25f2-4ca4-af1e-ec3f0b551d94', 'd8828187-0955-4a39-b51c-3468ad39e51b', '0e36c4b8-962c-4de6-840e-a194af276706', 'b1531bd0-4480-42d4-9be4-f3cfd51459b7'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:23 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:23 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:23:23 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:24 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.246s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:24 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Deleted volume successfully. Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8fb09310-0294-430e-b9d9-e16ee97c1255 tempest-ProjectReaderTests-768880665 None] Lock "cinder-37f1bd25-5b9e-43a1-ad61-bef75a3c36f2-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86840) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Flow 'volume_create_manager' (58ec6ffb-1bbb-4f01-8b5d-4a310e778728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e35317f-6aba-403d-9d84-62980656824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e35317f-6aba-403d-9d84-62980656824b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806590292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614c4e97-152d-400e-95fd-ac79e3a7d257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddcee4f2f4643018b45496bddd73b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:25Z,use_quota=True,user_id='4439f5e6910245bab75dc11e87ffc799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf061f8d-9513-4cf0-82b5-4f6cbce1b854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf061f8d-9513-4cf0-82b5-4f6cbce1b854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d670c3-9633-40ab-a02e-10530e1a0ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d670c3-9633-40ab-a02e-10530e1a0ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614c4e97-152d-400e-95fd-ac79e3a7d257', 'volume_name': 'volume-614c4e97-152d-400e-95fd-ac79e3a7d257', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f34ac4-9fb0-46cb-b5c7-00bf98bbb7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f34ac4-9fb0-46cb-b5c7-00bf98bbb7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5395016-6e05-4b51-96c3-33eedc0dd584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:24 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Volume 614c4e97-152d-400e-95fd-ac79e3a7d257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614c4e97-152d-400e-95fd-ac79e3a7d257', 'volume_size': 1} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806590292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614c4e97-152d-400e-95fd-ac79e3a7d257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddcee4f2f4643018b45496bddd73b70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:25Z,use_quota=True,user_id='4439f5e6910245bab75dc11e87ffc799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7),volume_type_id=0e4c21be-7d9f-4f42-a3ad-af0a68cdeba7)}" {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.remotefs [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Creating volume 614c4e97-152d-400e-95fd-ac79e3a7d257 {{(pid=86840) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Selected osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 as target Quobyte volume. {{(pid=86840) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:23:24 devstack cinder-volume[86840]: INFO cinder.volume.drivers.remotefs [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] casted to osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901 Nov 02 10:23:24 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257 1073741824 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:24 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257 1073741824 Nov 02 10:23:24 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:25 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257 1073741824" returned: 0 in 0.390s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:25 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257 Nov 02 10:23:25 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:25 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257" returned: 0 in 0.234s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'} {{(pid=86840) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5395016-6e05-4b51-96c3-33eedc0dd584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614c4e97-152d-400e-95fd-ac79e3a7d257', 'volume_size': 1}' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d5f824-45af-4b25-84ba-ab6ad724c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:23:25 devstack cinder-volume[86840]: INFO cinder.volume.flows.manager.create_volume [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Volume volume-614c4e97-152d-400e-95fd-ac79e3a7d257 (614c4e97-152d-400e-95fd-ac79e3a7d257): created successfully Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d5f824-45af-4b25-84ba-ab6ad724c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86840) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Flow 'volume_create_manager' (58ec6ffb-1bbb-4f01-8b5d-4a310e778728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86840) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:23:25 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-77f5542f-f0e6-407f-bcf8-5cca5df792d7 tempest-ProjectReaderTests-768880665 None] Created volume successfully. Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Acquiring lock "cinder-614c4e97-152d-400e-95fd-ac79e3a7d257-delete_volume" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Lock "cinder-614c4e97-152d-400e-95fd-ac79e3a7d257-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Acquiring lock "cinder-quobyte-614c4e97-152d-400e-95fd-ac79e3a7d257" by "delete_volume" {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Lock "cinder-quobyte-614c4e97-152d-400e-95fd-ac79e3a7d257" acquired by "delete_volume" :: waited 0.018s {{(pid=86840) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f8abd-2a6e-45d1-b85c-b7f96e9d7376]: (4, 'qcow2') {{(pid=87654) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:23:25 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:25 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257 Nov 02 10:23:25 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:26 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257" returned: 0 in 0.347s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:26 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257 Nov 02 10:23:26 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:26 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86/volume-614c4e97-152d-400e-95fd-ac79e3a7d257" returned: 0 in 0.230s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Lock "cinder-quobyte-614c4e97-152d-400e-95fd-ac79e3a7d257" released by "delete_volume" :: held 0.617s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG cinder.quota [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Created reservations ['fa9bb334-da90-47a3-b72b-e0abef34f2ec', '4f95e805-45c5-4733-a4b4-027f32582e87', '62a644d5-f3c3-44bd-b43a-dfe923e9bb26', '693a9140-7187-457d-abaf-040ae197a896'] {{(pid=86840) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901': None} {{(pid=86840) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG cinder.volume.drivers.quobyte [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b6e56d68-1fb7-41c7-b9af-7ce0fb2fd901'] {{(pid=86840) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.lockutils [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86840) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:23:26 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86 Nov 02 10:23:26 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:23:26 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG oslo_concurrency.processutils [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5568044602e081fa877b90c28b188e86" returned: 0 in 0.230s {{(pid=86840) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG cinder.manager [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Notifying Schedulers of capabilities ... {{(pid=86840) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:23:26 devstack cinder-volume[86840]: INFO cinder.volume.manager [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Deleted volume successfully. Nov 02 10:23:26 devstack cinder-volume[86840]: DEBUG cinder.coordination [None req-8f831bdc-6c73-4e97-9d3f-cb60d179daa2 tempest-ProjectReaderTests-768880665 None] Lock "cinder-614c4e97-152d-400e-95fd-ac79e3a7d257-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=86840) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:23:36 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:UPDATE=22,cinder:SELECT=15,cinder:INSERT=4 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:23:36 devstack cinder-volume[86840]: DEBUG dbcounter [-] [86840] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}